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measurement; and 7) the affective relevance of learning games and 
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Preface 



The National Special Media Institutes is a consortium of higher edu- 
cation institutions: The Instructional Media Center, Michigan State Uni- 
versity; United States International University in San Diego; the Center 
for Instructional Communications, Syracuse University; and the Depart- 
ment of Instructional Technology, the University of Southern California. 
These orgaiiizationshave joined together to work cooperatively on projects 
of national interest which are significant to the development of the field 
of instructional technology. 

A series of seminars sponsored by the U.S. Office of Education and 
coordinated by the National Special Media Institutes through Teaching 
Research, probed the relationship between the behavioral sciences and 
the field of instructional technology. The first seminar was devoted to 
the cognitive area, the second to the affective area, and the third to the 
psychomotor area. This volume and the two which follow represent new 
substantive inputs to the field of instructional technology. As the field 
grew out of its traditional audiovisual product orientation, new insights 
were required to emphasize the process approach. The behavioral sci- 
ences seemed to have more to contribute hi this vein than any other 
substantive field. 

The keen interest in the affective area in education caused this, 
volume to l e published first. It is more than the proceedings of a 
conference. It is a carefully edited volume for which original p »^prs 
were prepared. These papers were revised on the basis of discussions 
held at the seminar between behavioral scientists and instructional tech- 
nologists who interacted freely and openly. The papers were then sub- 
jected to a final review by Dr. Jack Crawford and Dr. Floyd Urbach of 
the Teaching Research Division. 



The credit for this volume and the work of the National Special 
Media Institutes should be given to the late Dr. James D. Finn of the 
University of Southern California who originally conceived the con- 
sortium and stressed ihe need for new inputs to the growing field of 
instructional technology. The genius of Jack Edling and his staff at 
Teaching Research made the seminars possible in an attractive Oregon 
locale. Such environmental stimuli added to the quality of the discus- 
sions. 



Syracuse, New York Donald P. Ely 

June 1970 
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Introduction 



Jack Crawford 



The seven chapters of this volume present at least seven diverse view- 
points written by seven different sets of authors. Both the chapters and 
authors possess one common attribute: A concern with developing in- 
struction which interests, involves, and motivates learners. Seven facets 
of human feelings, or affect, are presented by authors who have been 
engaged in the basic research and instructional applications of that par- 
ticular approach. 

The book is intended primarily for the instructional technologist who 
is involved in designing, developing, or revising instructional systems. 
However, the chapters are useful to anyone concerned with the improve- 
ment of instruction. The reader will find that each chapter loosely fits a 
three-stage pattern: 

• The approach and its background 

• Examples of the research and developmental studies 

• Implications for instruction. 

The reader should be alerted that the seven approaches selected do 
not blanket the field of affect. Nor does the volume present an overview 
or an encompassing theory of the entire field. It contains seven inde- 
pendent and prominent developments stemming from the behavioral 
sciences. Criteria for sele^ction were: 

• The approaches sjiquld differ markedly trom one another and 
be representative of a wide range of research and development 
pursurts.. 

• Each approach should be supported by at least a moderate 
amount of prior research and development exploration, 
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• Implications for instruction should be clearly identified. 

• The authors were available and willing. 

The present chapters are the outcome of the authors' original genius 
as influenced by exchanges with the seminar staff of Teaching Research 
and tempered in a trial by fire and fluids. The latter consisted of a 
four-day symposium, on the Oregon Coast, at which each author pre- 
sented his chapter and was then honored with constructive assistance 
from each of the other authors, members of our own. staff, and repre- 
sentatives of the primary target group— the instructional technologists. 
Thus glutted with useful suggestions, the authors re Lire d homeward and 
revised their chapters. 

In the first chapter. Bill Barber discusses Human Relations Training.. 
His concept of Human Relations Training encompasses the activities of 
T-Groups, sensitivity training and encounter groups— activities recently 
marked by flourishing applications throughout education and manage- 
ment training. Bill holds the equivalent of the Black Belt in group 
processes, and is actively engaged in organizational and institutional 
applications of this approach. 

Achievement Motivation, the second chapter, is authored by David 
McClelland, who writes from a background of more than twenty years 
of directing the leading research programs in this area- 
Charles Spielberger copes with Anxiety in the third chapter. New 
theoretical constructs and a resultant series of research studies exploring 
the relationships between anxiety and learning represent part of Charles 
Spielberger's professional contributions which are reflected in this chap 
ter. 

O.J. Harvey summarizes his study of four types of belief systems, or 
major value orientations typical of our culture. Their interactions with 
curriculum, teacher, student, parent and child are carefully educed from 
the original research of Harvey and his colleagues. 

Fred McDonald and Catherine Kielsmeier integrate a presentation of 
Social Learning, or Modeling, as a theory of human learning with a clear 
and cogent summary of its applications to instruction and teacher train- 
ing. Fred McDonald's own studies constitute a major portion of both 
the basic research and applied studies in this area, 

Allen Edwards and Betty Porter present a readable account, and one 
particularly useful to the instructional technologist, of the problems and 
techniques of attitude measurement. A series of original contributions to 
attitude scales and scaling techniques distinguish Allen Edwards' profes- 
sional productivity. 

In the seventh and final chapter, Paul Twelker and Jack Crawford 
attempt to summarize developments in the field of Simulation and 
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Learning Games relevant to affect. Paul has published extensively in 
both the research and instructional aspects of simulation. Crawford has 
played a variety of games for many years. 

Staff members of Teaching Research have participated in thj produc- 
tion of this volume in various ways. Special mention n?'^Jb to be made, 
however, of Cathy Keilsmeier who contributed VuvA editorial assistance 
to several chapters. 
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Human Relations Training 
and the Innovation Consultant 



William H. Barber 

Western Behavioral Sciences Institute. 
La Jolla, California 

// facts are the seeds that later produce knowledge and 
wisdom, then the emotions and the impressions of the 
senses are the fertile soil in which the seeds must grow. 

■Rachel Carson - The Sense of Wonder 

The third session opened with comments by a few members 
who noted that they felt clearer about the purpose of the 
T-Group. They had just listened to a theory session concerned 
with emotional patterns and group behavior, and they now felt 
that the task was to bring out on the table and discuss some of 
the emotional feelings of various group members so that the 
group could better understand its problems. 

From the beginning, Don, an intense, eager, apparently anx- 
ious member, had rushed in with suggestions for group action. 
He had been the first to move on the opening day with a 
suggestion leading toward introductions. However, as the ses- 
sions continued, his interventions had decreased, in relevancy to 
what was happening in the group. Most of his contributions 
were lengthy, and all of them dealt with some topic that was 
far from the group and usually rooted in some personal situa- 
tion he faced in his work backhome. His interventions came at 
times when the group was moving toward a decision-usually 
toward a decision to discuss behrv^'ior within the group. One 
member of the group asked Dor. directly why he always 
brought up something of his own just when the group was 
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beginning to discuss a group problem. Don hotly denied that he 
had dehberately done so. He said he had been sitting there, 
thinking both about the group and his own problems, and it 
seemed to him the questions he had in his own situation were 
ones that would interest and help the group. After all, he 
added, his company was sending him here lo get something out 
of the program. 

At this point, another member asked, ''If you spend ail the 
time bringing your problem in, how will the rest of us get any 
help on ours?It seems to me that we will get the most help as 
we figure out wJiat we are doing here and how we can improve 
the situation." 

A third member rushed in, however, to defend Don. "Every- 
body," he said, "must have the riglit to speak. If Don has 
something to say to the group, no matter what it is, we should 
all listen to it. 1, for one, think that Don's problems are very 
serious problems, and 1 would like to hear him talk about them 
at greater length." ^ 

Don took this as sanction to continue describing a particular 
back-home situation. His description continued for nearly five 
minutes. Attention in the group continued to fade, and restless- 
ness became apparent. 

After Don had finished his statement, one trainer com- 
mented on the growing lack of attention when individual back- 
home problems were discussed, as compared with the greater 
attention when present group problems were being discussed. 
At the same time, he added, a number of group members speci- 
fically stated that they did not wish to work on present group 
problems. The trainer indicated that this seemed to present a 
dilemma to the group. (Bradford, Gibb, & Benne, 1964, pp. 
144-145.) 

This episode illustrates a number of the features of the experience- 
based learning innovation called the T-Group. The T-Group, along with 
other elements such as lectures and skill ^sxercises, forms the basis for 
"human relations training." 

This paper is an effort to (1) summarize briefly the state of the art 
and science of human relations training, and (2) illustrate how the ap- 
plied behavioral sciences can help understand the role of media specialist 
as an innovation consultant. 

Human Relations Training 

There are a number of characteristics that distinguish human relations 
training from other parts of the human poJential movement and from 
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Other forms of experience-based education. Among them are (1) the 
learning goals, (2) the desired outcomes and (3) the assumptions about 
the learning process that are associated with human relations training. 

Goals 

At one level of abstraction there are a number of very general goals. 
These result from the scientific and philosophical values underlying the 
method. Schein and Bennis (1965) describe five such metagoals: (1) an 
expanded interpersonal awareness and recognition of choice points. 
Choice points are the irregular, critical points in u person's life where 
normal expectations are violated. These are tlie "forks in the road" 
where choices are made— consciously or unconsciously; (2) a spirit of 
inquiry or a willingness to try oi^- new behavior; (3) an increased au- 
thenticity in interpersonal relations; being able to accept the experience 
of being oneself. As one becomes more able to accept and respond to 
his own experience he becomes less inclined to respond primarily to 
others' expectations; (4) an ability to act in collaborative and inter- 
dependent ways rather than in authoritarian and hierarchical ways; and 
(5) an ability to resolve conflict through open and creative problem 
solving instead of through power strategies such as coercion, manipula- 
tion or horse trading. 

Underlying these metagoals is the implicit notion that openness is 
desirable in interpersonal relationships. By openness is meant behaviors 
by person A that communicate to person B the present interior experi- 
ences of person A. The interior experiences that are relevant are usually 
his feelings, wishes and perceptions about the activity in which they are 
both presently involved. Openness is sometimes confused with self- 
disclosure or "personalness"; the latter denotes sharing past events or 
past interior states. Since openness relates the phenomena experience, 
and shared at the present time, being "open" is likely to result in more 
growth-producing relationships fhan is being "petsonal." This is because 
in an open relationship each person has maximum information about 
himself as well as about the other, and therefore maximum alternatives 
and freedom for choice. 

Metagoals such as these underlie the format of a human relations 
laboratory. They guide staff decisions and shape stated goals such as 
those that follow. These are described in the literature and are likely to 
be communicated to participants beginning a laboratory: 

1. Self-insight. Human relations training aims to bung about greater 
awareness of one's self and one's own behavior in a social context. By 
exploring the feelings and perceptions of others about one's behavior in 
an atmosphere of trust, one can learn to understand why he acts in 
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certain ways in certain situations. Increased self-awareness is seen as 
resulting in less defensive ness and more openness and authenticity. 

2. Sensitivity. Increased sensitivity to beliavioial cues (gestures, body 
position, voice, etc., as well as verba) stimuli) and "ncreased accuracy at 
inferring emotions underlying these cues, are seen as major goals. In- 
creased empat.iy, responsiveness, and spontaneity are seen as resulting 
from greater sensitivity. 

3. Group process knowledge. What are the types of events that fac:M- 
tate or inhibit group functioning? What unstated rules governing be- 
havior exist and how do such rules develop? What kinds of behavior 
cause changes in morale, activity level, and group productivity? System- 
atic ways of learning about such variables are frequently viewed as ap- 
propriate goals. 

4. Diagnostic skills. Achieving the first three objectives provides the 
basis for diagnostic ability, i.e., the ability to use relevant explanatory 
categories for organizing appropriate data about the social behavior of 
self, others and the "organization/' 

5. Action skills. The goal of increasing action skills is at the inter- 
personal rather than the technical level, i.e., the ability to intervene in 
social situations in order to facilitate behavior that increases member 
satisfactions or productivity. 

6. Learning how to learn~iho ability to continually monitor and 
modify one's behavior* It refers to one's psychological stance toward 
himself in social interaction; an attitude toward self and others that is 
manifested in a high commitment to becoming part of an open, self- 
renewing interpersonal system. 

Range of human relations activities 

Because of differing emphasis and priorities among these objectives, 
one finds a great range of learning experiences under the rubric of 
human relations training. Figure 1 describes the continuum. At one end 
of the personal growth goals of self-awareness and sensitivity are empha- 
sized; at the other more organizational goals such as cognitive under- 
standing and specific skills in influencing group and inter-group phe- 
nomena are stressed. 

Other dimensions may be noted. Depending on one's theoretical - 
point of view, one miglit also describe the personal growth activities 
listed as more "person-oriented" versus "organization-oriented"; or as 
more "emergent" as opposed to more ''planned"; or as more "facilitat- 
ing" rather than "intervening." Decisions about which treatment meth- 
ods are most useful should depend on careful diagnosis of client needs 
and on one's assumptions about how learning and growth take place. 
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Figure 1 
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Learning outcomes 

Outcomes of human relations training can be classified in terms of 
potential individual, group, and organizational learning and provide a 
second means of distinguishing human relations training from other 
modes of experience-based learning. 

1. Individual learning. Most participants in human relations training 
gain a picture of the impact that they make on other group members. A 
participant can assess the degree to which that impact corresponds with 
or deviates from his conscious intentions. He can also get a picture of 
the range of perceptions accompanying any given act. It is as important 
to understand that different people may see the same piece of behavior 
differently-for example, as supportive or antagonistic, relevant or irrele- 
vant, clear or ambiguous— as it is to understand the impact of any given 
individual. Rarely do all members of a group have even the same general 
perceptions of a given individual or a specific event. 

Some people report that they try out new behavior that they have 
never tried before. This experimentation can enlarge their view of their 
own potential and competence and provide the basis for continuing 
experimentation. 

2. Group learning. One learns about the forces which affect the 
group such as the results of different methods of making decisions, the 
norms controlling the amount of conflict and disagreement that is per- 
mitted, and the kinds of data that are gathered, e.g., early in the life of 
a group, cognitive data tends to be gathered more frequently than af- 
fective data; as the group develops, a higher proportion of affective data 
is gathered. Concepts such as cohesion, power, group maturity, climate, 
and structure can be examined using the experiences in the group to 
better understand how these same forces operate in the back-home situa- 
tion. 

3. Organizational learning. Status, influence, division of labor, and 
styles of managing conflict are among organizational concepts that may 
be highliglited by analyzing the events in the small group. Subgroups 
that form can be viewed as analogous to units within an organization. It 
is then possible to look at the relationships between groups, examining 
such factors as effectiveness of communications, stereotyping, and com- 
petitiveness versus collaboration. 

*A participant is able to examine the kinds of assumptions and values 
which underlie different leadership styles. The opportunity to link up a 
philosophy of leadership with specific behaviors that are congruent with 
or antithetical to that philosophy makes human relations training partic- 
ularly relevant to understanding the organization (Seashore, 1968). 
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Underlying assumptions about learning 

The following assumptions about the nature of the learning process 
distinguish human relations training from more traditional models of 
education: 

1. Learning responsibility. Each participant is responsible for his own 
learning. What a person learns depends upon his own style, readiness, 
and the relationships he develops with other members of the group. 

2. Staff role. The staff person's role is to facilitate the examination 
and understanding of the experiences in the group. He helps participants 
to focus on the way the group is working, the style of an individual's 
participation, or fhe issues that are facing the group. 

3. Experience and conceptualization. Most learning is a combination 
of experience and conceptualization. A major aim is to provide a setting 
in which individuals are encouraged to examine their experiences to- 
gether in enough detail so that valid generalizations can be drawn. 

4. Authentic relationships and learning, A person is most free to 
learn when he estabUshes authentic relationship,:^. When such relation- 
ships are established one is able to increase his sense of self-esteem and 
decrease his defensiveness. In authentic relationships one can be open, 
honest, and direct with another so that he is communicating actual 
feelings rather than masked feelings. 

5. Skill acquisition and values. The development of new skills in 
working with people is maximized as a person examines basic values 
underlying his behavior^ as he acquires appropriate concepts and theory, 
and as he is able to practice new behavior and obtain feedback on the 
degree to wliich his behavior produces the intended impact (Seashore, 
ibid.). 

Research Evidence 

The research evidence on the effectiveness of human relations training 
is ambiguous. This state of affairs, along with the fact that attitudes of 
social scientists toward human relations training tend to be bi-polar and 
strong, results in contradictory interpretations of the evidence that does 
exist. Consequently, in ev?'uating research reviews, practitioners find the 
evidence supports the hypothesis that training leads to behavior change. 
Non-practitioners revieiv the same literature and find it indicates little or 
no change as a result of training. 

The ambiguity surrounding the research evidence seems due primarily 
to research design difficulties. Illustrative of the most formidable are: 

1. Desired outcomes are broad and frequently abstract changes in 
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inlrapersonal and interpersonal behavior, including Inler-rclated combina- 
tions of values; knowledges, attitudes, motivations, perceptions and 
specific behavioral skills. The goal of "increased sensitivity," for exam- 
ple, involves all of the above elements. A research design and learning 
theory that specifies the relation between such outcomes and appropri- 
ate learning experiences is yet to be developed. 

2. If changes do occur the problem of observing and measuring re- 
mains. Althougli a number of sub-problems exist, there are two major 
issues: first, one needs to specify changes occurring from beginning to 
end of training; second, one needs to describe how such changes transfer 
and are manifested in the back-home setting. Does one really learn to 
■express his feelings more accurately and is he able to do so on the job? 
Or, as some critics suggest, has he simply learned to apply a new set of 
verbal symbols to the same experience? Both kinds of questions need 
specification in terms of cognitive and affective outcomes along with 
more precise and imaginative approaches to observation and measure-, 
ment. 

3. As in research in other areas such as psychotherapy, the provision 
for adequate control groups is a continuing difficulty. Briefly, the issue 
is that if a subject is in a control group it may bias his and others' 
perceptions of him; if a subject has been through training it may give 
him and others a "set" to expect changes. 

These three problems illustrate typical difficulties encountered in at- 
tempting to rigorously assess the effects of human relations training. 
Despite this confusion, however, it seems the following conclusions can 
be drawn about the effects of human relations training: 

1. Many individuals report extremely significant changes and impact 
on their lives as workers, family members, and citizens. This kind of 
anecdotal report should be viewed cautiously in terms of application to 
job settings, but it is consistent enougli that it is clear that human 
relations training experiences can have a powerful and positive impact 
on individuals. Rouglily two«thirds of the participants are seen by them- 
selves or others as increasing interpersonal skills after attendance at 
laboratories. This figure represents an average across a number of stud- 
ies. 

2. People who attend sensitivity training programs are more likely to 
improve their leadership skills than those who do not (as reported by 
their peers, superiors, and sabordinates). Although definition of "leader- 
ship skills'' vary with different studies there is evidence citing improved 
interpersonal behavior (e.g., accuracy of communications, changes in 
morale level) as well as studies showing improvement in productivity. 

3. The ii.icidence of serious stress and mental disturbance during 
training j.^. difficuit to measure, but it is estimated to be less than one 
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percent of participants, and in almost all cases occurs in persons with a 
history of prior disturbances (Schein & Bennis, 1965). 

This section has attempted to describe human relations training-its 
purpose, philosophical beliefs, assumptions about learning and research 
base. The media consultant will, of course, draw his own conclusions. As 
he goes about the task of planning ways to influence learning in the 
affective domain, it is hoped that he gives some consideration to these 
hypotheses: 

1. People learn more when they have the responsibility for designing 
their own learning experience. 

2. People learn more when they have the skills that enable them to 
influence other people and, thereby, the social context of learning. 

3. People learn more when their emotions and perceptions are seen 
as providing relevant and appropriate information. 

4. People learn more when the people around them model the kind 
of behavior that is seen as desirable. 

5. People learn more when they are clear about their relationships to 
significant others. 

6. People learn more when self-assessment of performance is as val- 
ued as external assessment. 

The Media Specialist as Innovation Consultant 

What can be said about the relevance of the applied behavioral sci- 
ences, of which human relations training is one part, for the media 
specialist? I wish to focus on one part of this question and assume that 
the media specialist is among other things an "innovator" who has two 
functions: 

1. to develop and implement innovation; 

2. to develop and implement "innovative systems/' i.e., he has the 
mission of helping otliers become innovators. He attempts to create 
persons and situations which are increasingly innovative and decreasingly 
dependent upon him. 

Thus> in addition to technical competency, this role requires other 
competencies in order to build and maintain innovative systems, i.e., 
help others become innovators. It is to these latter competencies-those 
needed for introducing and maintaining innovations— that I wish to ad- 
dress the rest of this paper. I think Hits applied behavioral sciences are 
relevant for providing some mapping and planning of this process. 

Before describing a way of looking at the prt^cess of planned innova- 
tion let me state some assumptions about people, organizations and 
change. 
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Some assumptions: 

1. Most individuals wish to grow and develop. 

2. Most individuals want their organization to succeed. 

3. Most individuals tend to be resistant to innovation, particularly if 
goals or means toward them are unclear. 

4. Individuals tend to support innovation more if they have partici- 
pated in planning it. 

5. Individuals can learn to improve their diagnostic ski5ls to better 
analyze a situation and plan appropriate change. 

6. Any change in a sub-system is likely to affect the whole system. 

7. Every change effort involves changed attitudes. Attitudes must be 
unfrozen, new ones learned, and refreezing achieved. 

8. A basic change is to create conditions where those affected by 
the change can systematically and meaningfully plan it and carry it out. 

9. To change a sub-system, relevant aspects of the environment 
must also be changed. 

10. The place to begin an innovation effort is where stress or strain 
or an identified problem exists-not necessarily at some arbitrary point 
in the system. 

11. If basic structural changes are contemplated, change should start 
at the policy-making level. 

12. A personal relationship of trust and mutual confidence must be 
established with each "client" as early as possible. 

13. The innovator must deal with the dependency relationship usu- 
ally existing in a helping relationship. 

14. He should concentrate on diagnosis of the problem and avoid the 
temptations of early solutions. 

15. He should control his own needs to control the situation or the 
client. 

16. He should avoid 

— defending . , 

— advising 

— premature persuasion 

— over-controlling. 

17. The innovator^ must build in plans for stabilizing and maintaining 
the innovation without undue dependence on him (Beckhard, 1967). 

These assumptions can give one a framework for understanding cer- 
tain critical issues in the innovation process, but it is a framework for 
"our ball park," the point of view of the innovator. How do things 
look, how is the innovator viewed from "their ball park," the educa- 
tional constituencies involved? Figure 2 provides a way of understanding 
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Figure 2. Model for Understanding an Individual's Response to Innovation'** 
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the experiential world of the person whom the innovator hopes to in- 
fluence. 

One is vividly reminded of the fact thai it is the person's perception 
of the innovator and the innovation, not objective reality that deter- 
mines response. The human or "people" issues are at least as important 
as the technical quality of the innovation, especially when viewed from 
the ''consumerV frame of reference. Much effort is devoted to human 
relations training in industrial organizations in order to assist persons in 
adaptiiig to change in their jobs. A relatively sophisticated behavioral 
science technology, frequently called ''organization development" is 
resulting. 

Innovation consultation 

One can think of the innovation process from the standpoint of the 
knowledge, sensitivities and skills required by the innovator-consultant. 
He needs to be able to: 

1. Diagnose the needs and problems of the client system. What is the 
trouble and what is the cause of the trouble? 

2. Assess the motivation of the system to change itself. What are 
resources for and resistances to innovation? Is there awareness of the 
need for innovation? Are thuie feelings that innovation will be threat- 
ening? Rewarding? 

3. Assess his own motivations and resources as the agei.' for influ- 
ence and change. Why do I wish to help this person or this system? 
What are the limits of my ability to help? 

4. Develop and manitain a working relationship with the client sys- 
tem. This means establishing a mutually acceptable and widely under- 
stood picture of the responsibilities of the innovator in helping the 
client solve his problem. 

5. Choose the niost effective role. Should the innovator counsel? 
Demonstrate? Encourage? Mediate? Communicate a wider view of reality 
to the client? 

6. Select appropriate targets for innovation. Of all possibilities what 
are most significant? Realistic? What should be the first step in an 
experiment in innovation? 

7. Encourage and support innovative att\3mpts. What rewards can be 
provided for new responses? Remove rewards for old responses. Is the 
innovation consistent with the institutional standards? 

8. Terminate (or redefine) the lielping relationship. When and how 
does the innovation consultant leave the client alone? 

Except for termination, tliese phases come up over and over in the 
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process of introducing innovations and lielping otliers to become intro- 
ducers of innovations. • 

Tlicve is a teclinology for tliis process wliich is emerging from appli- 
cations of tlie beliavioral sciences to organizational cliange efforts. One 
part of tliis teclinology is human relations training. Other parts are de- 
scribed in the materials cited in the list of references. And still others 
are quickly developing. It is exciting to work toward innovation and 
renewal in educational systems; it is especially exciting to aim toward 
the emergence of self-innovating, self-renewing educational systems. 

References 

Argyris, C. Interpersonal competence and organizational effectiveness. Chicago: 
Irwin-Dorsey, 1962. 

Argyris, C. Interpersonal competence and organizational behavior. Homewood, lU.: 
Irwin, 1962. 

Bennis, W. G., Bennc, K. D., and Chin, R. The Planning of Change. New York: 
Holt, Rinehart & Winston, 1961. 

Beckhard, R. Some assnmptions abont change in organizations. Unpublished manu- 
script. Boston: Massachusetts Institute of Technology, 1968. 

Berzon, B., and Solomon, L.N. Research frontier: The self-directed therapeutic 
group-three studies. Journal of Counseling Psychology . 1966, 13, 491-497. 

Bradford, L. T., Gibb, J. R., and Lippitt, G. L. Human relations training in three 
days. /Ic/fz/f leadership. 1956,^, 11-26. 

Bradford, L. P., Gibb, J. R., and Benne, K. D. T-grDup theory and laboratory meth- 
od. New York: Wiley, 1964. 

Brown, G. I. Now: The human diirietision. A report of the Ford-Esalen project for 
innovation in humanistic education. Big Sur, California: Esalcn Institute, 
1968. 

Buchanan, P. C, Innovation in education. .fGSL' Newsletter. 4:3, 1965. Ferkauf 
Graduate School of Educatfon, Veshiva University. 

Buchanan, p. C. Evahiating the effectiveness of laboratory training in indusUy. In, 
Explorations in human relations training and research. No. p. Washington, 
D.C.: National Training Laboratories-National Education Association, 1965. 

Bugental, J. F. T. The search for authenticity. New York: Holt, Rinehart & Win- 
ston, 1965. 

Campbell, J. P., and Dunnette, M. C. Effectiveness of T-group experiences in man- 
agerial training and development. Psychological Bulletin, 1968, 70, 73-104. 

Fricdlander, F. The impact of organizational training laboratories upon the effec- 
tiveness and interaction of ongoing work groups. Personal Psychology, 1961 , 
20, 289-308. 

Gibb, J. R., and Gibb, L. M. Emergence therapy: The TORI process in an emergent 
group. In G. M. Gazda (EdO, Innovation"^ in group psychotherapy. Springfield, 
111.: C. C. Thomas, 1968. Pp. 96-129. 

Gibb, J.R. Effects of human relations training. In A.E. Bergin and S. L. Garfield 
(Eds.), Handbook of psychotherapy and behavior change. New York: Wiley, 
in press. 



14 THE AFFECTIVE DOMAIN 



Hacon, K. i . Management training: aims and methods. London: English Universities 
Press, 1961. 

Harrison, R. Problems in the design and interpretation of research on human 
relations training. Explorations: Human Relations _ -Training and Research, 
Washington, D.C.: National Training Laboratories-Institute for Applied Be- 
havioral Science, 1'967. 

Lippitt, R., Watson, J., anci Wesley, B. The dynamics of planned change. New 
York: Harcourt Brace, 1958. 

Miles, M. B. Human relations training: Processes and outcomes. Journal of Coun- 
seling Psychology, I960, 7, 301-306. 

Miles, M.8. (Ld.), Innovation in education. New York: Bureau of Publications, 
Tcacliers College* Columbia University, 1964. 

Miles, M. B. Changes during and following' laboratory training:- A clinical experi- 
mental study. Journal of Applied Behavioral Sciences, 1965, I, 215-242. 

Otto, H. A., and Mann, J. Ways of growth: Approaches to expanding awareness. 
New York: Grossman, 1968. 

Schein, E. H., and Bennis, W. G, Personal and organizational change through group 
methods: The laboratory approach. New York: Wiley, 1965. 

Shepard, H, A. Clianging interpersonal and intergroup relationships in organiza- 
tions, in J.G. March (Ed.), Handbook of organizations. Chicago: Rand Mc- 
Nally, 1965. 

StoUer, P\ H. Marathon group therapy. In G. M. Gazda (Ed.) .Innovations in group 
psychotherapy. Springfielid, 111.: C. C. Thomas, 1968. Pp. 42-95. 

Tannenbaum, R., Weschler, 1. R., and Massarik, F. Leadership and organization: A 
behaviorai science approach. New York: McGraw-Hill, 1961. 



The Role of Educational Technology 
in Developing Achievement Motivation 



David C. McClelland 
Harvard University 



For the past seven or eight years we have been studying how to 
develop achievement motivation in students and adults. To understand 
what we have been trying tc do it is necessary to say a word or two 
about what we mean by ''achievement motivation/' the ''need to 
achieve" or as it is often abbreviated, "/? Achievement." Initially we 
started out with a very simple idea-namely, that the measure of 
achievement motivation should sensitively reflect its presence, or absence 
or variations in strength in a given individual. So we aroused achieve- 
ment motivation in groups of college men and searched for a behavioral 
index which would give higher readings from the aroused students than 
from comparable groups of students whose motivation had not been 
aioused. To use a very crude analogy, we increased the fire under the 
boiler and searched for an indicator which would accurately reflect the 
increased steam pressure. We found that fantasy most sensitively re- 
flected changes in motivational states and gradually over a period of 
years we discovered that certain types of fantasies-namely, those con- 
cerned with doing well, or doing better than one had done before, or 
improving performance—most accurately reflected increases in induced 
achievement motivation. We developed objective methods of coding fan- 
tasy for these types of imagery and re/erred to the frequency with 
which an individual introduced them into stories he wrote to pictures as 
his n Achievement (need for Achievement) score. This, of course, was 
only the beginning, The question was whether this index, if high, would 
accurately predict that a person would behave in ways that would gen- 
erally be regarded as more motivated for achievement. 
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A number of behavioral theorists have argued that a motive drives, 
directs, and selects beiiavior. Thus a hungry person is more activfi nor- 
mally, or more driven. He is also more directed toward certain aspects 
of the environment than others. He is much more alert to food cues in 
the environment than to cues, let us say, dealing with achievement. That 
is, if he is walking down the street he will notice a restaurant sign 
before he'll notice a book store sign. He will also learn how to overcome 
obstacles and get the food faster, if he is hungry. In some way the 
hunger drive serves to select out and stamp in the responses which lead 
to the food. 

So we set out to discover whether our measures of n Achievement 
did in fact show whether individuals who scored high on it would be- 
have as more motivated people should behave. In fact they did. They 
outperformed people with low n Achievement scores. That is, they 
seemed more energized. They improved in learning certain tasks faster. 
That is, the achievement motive seemed to help them select ways of 
solving the problems faster. And their attention was more often directed 
to achievement aspects of the environment. For instance, they tended to 
recall more often tasks which they had failed to complete— which were 
still challenging-whereas people with low n Achievement -generally 
tended to recall completed tasks better. 

For over twenty years we worked steadily on trj'ing to find out what 
the behavioral characteristics were of people who were highly motivated 
to achieve as contrasted with those who were not. It is not possible to 
review much of this research, but one or two points are particularly 
worth mentioning. In the first place, it soon became obvious that the 
need to achieve did not lead to superior performance at all sorts of 
tasks. In fact, if it had, we could have used superior t^sk performance 
itself as a measure of motivation. But a higlier n Achievement did not 
lead people to perform better at routine tasks or tasks that had too 
little a chance of being successfully completed. It only led people to 
perform consistently better if the tasks were "challenging," that is, were 
neither too easy or too hard but had a moderate probability of success. 
Thus it is unsafe and incorrect to infer, as laymen often do, that when- 
ever a person does better on a test, it must mean that he has a higher 
need to achieve. Good conscientious performance in school, for exam- 
ple, leading to higher grades, does not always or even often indicate a 
higlier n Achievement. Also somewhat paradoxically a person's belief 
that he is achievement oriented is in no way connected with whether he 
gets a higli n Achievement score. In other words, we must distinguish 
clearly between attitudes towards achievement and n Achievement. 
Again and again research has shown that people who value achievement 
in all sorts of ways as measured by attitude scales are not necessarily 
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those who generate spontaneously thoughts about achieving in creating 
fantasies in response to pictures. Perhaps it is best then to summarize by 
saying that what we mean by n Achievement is best conceived as a kind 
of spontaneously recuiiing concern to do things better, whicli a person 
may or may not be aware that he has. This spontaneously recurring 
concern leads the individual to be active in very specific ways. He seeks 
out challenging, moderately difficuU tasks, does better at them, is very 
interested in feedback from the task as to how well he is doing, does 
not like to gamble or be directed by someone else as to what he should 
do, is restless and seeks out new tasks because the old ones get boring as 
the probability of succeeding at them increases. 

Having built up a considerable body of information about the 
achievement motive and how it influenced individuals, we felt we should 
be in a good position to teach it to people. In fact we have turned out 
to be fairly successful in doing so. Since all of our research had shown 
that the characteristics of the person with high n Achievement should be 
particularly useful in an entrepreneurial role, we began by trying to 
develop achievement motivation in small businessmen more ,^r less in 
charge of their own businesses. The results of these efforts are fully 
described in a book by myself and David Winter entitled Motivating 
Economic Achievement (The Free Press). In brief, we found that in 
short intensive courses lasting from 25 to 100 hours usually concen- 
trated in 5 to 10 days, we could "turn on" small businessmen and make 
them much more entrepreneurial over several years following the train- 
ing. In round numbers, about one-quarter to one-third of the small 
businessmen with whom we worked would become unusually active in 
any given two-year period if none of them underwent achievement mo- 
tivation training. However, with such training, fully two-thirds of the 
men becar-^i-e active in the two years following it. The two-thirds rate of 
greatly improved performance held among all sorts of small businessmen 
-in black urban sections of the United States, in South Central India, or 
•in Catalonian Spain. 

Success with businessmen led us to try to develop achievement mo- 
tivation among students in the public schools. As already noted, there is 
reason to believe that achievement motivation is less likely to lead to 
superior performance in the school situation than in an entrepreneurial 
one, for the simple^ reason that many school tasks are not "challenging." 
In fact, to do better, it is often wise to conform and do conscientiously 
exactly what the teacher asks you to do. Perhaps for this reason our 
success in improving performance in schools has been less dramatic, 
though it is still substantial and perhaps greater than many of the other 
compensatory education programs that are so much in vogue today. To 
report the results of just an example of many attempts to introduce 
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'achievement motivation training into the schools, the work. by deCharnis 
et al (1969u) in St. Louis is fairly representative of what has been 
accomplished. They introduced achievement motivation ^raining for over 
250 black disadvantaged pupils in nine sixth grade classes. At the end of 
the year control children who had not received the training scored about 
a grade level behind where they should be on the Iowa Test of Basic 
Arithmetic Sk:ils. The comparable children who had received motivation 
training were only half a grade behind. That is, by practicing some 
simple motivational exercises which the teachers had been trained to 
introduce (see deCharms, 1969b), the disadvantaged cliildren had gained 
about half a grade in arithmetic skills after achievement motivation 
training over those who had :\ot received the special training. The result 
is very enr-oi^raging, particularly in view of the many discouraging re- 
ports coming in from other attempts at compensatory education. 

In planning and carrying out these many courses for developing 
achievement motivation, we have been constantly experimenting with 
methods of improving their yields. In fact our initial approach was 
frankly experimental, in the sense that we were thinking in terms of a 
kind of input-output analysis. That is Vv^e identified some twelve dif- 
ferent educational inputs that could conceivably help develop achieve- 
ment motivation, (McClelland and Winter, 1969) and then tried to find 
out which combination or combinations of them would give the highest 
yields in terms of such criteria as improved entrepreneurial performance 
or academic skills. Let me describe very briefly the nature of some of 
these educational inputs under foui major headings: 

The achievement syndrome. Here our goal is very simply to 
teach the participants what we have learned about how a per- 
son -with high n Achievement thinks, talks and acts and v;hy 
having a high need to achieve is relevant to, let us say, entre- 
preneurial success. To understand the thought patterns^ they 
learn the coding system for n Achievement and eventually learn 
to produce easily and spontaneously stories that score high in n 
Achievement. They also practice .the action characteristics of 
people with high n Achievement, such as choosing moderately 
difficult tasks in certain game situations, as in deciding how far 
to stand from a peg in ring toss. 

Self-study. Here various exercises are introduced to get the 
person to think what kind of a person he- is and wants to be. 
Privately and in groups (using some sensitivity training proce- 
dures) they discuss their motives and a.:pirations, the objective 
being to decide the role, if any, that they want achievement 
motivation to play in their lives. 
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Goal setting. They are also taught how to set realistic goals 
for themselves in terms of the weeks and months ahead. Most 
people begin with very vague goals, but the training procedures 
force them to set quite specific time-limited goals and invent 
measures of progre.ss so that they will know afterwards the 
extent to which they are achieving them. Thus they normally 
end the training with certain commitments for the days aher.d 
and with concrete ways of knowing whether tliey are fulfilling 
those commitments or not. 

Interpersonal supports. Since the training is done in small 
groups of around IS participants, it is relatively easy to create 
certain ''in-group" feelings which research has shown tends to 
support individuals in their efforts to change after they leave 
the training situation. Often the training is carried out in rela- 
tively isolated retreat settings which give the individual the 
opportunity to reflect on his life and form new associations 
with others which will continue to support and guide him when 
he returns to everyday living. 

The theoretical reasons for thinking that each of these types of in- 
puts miglit develop motivation are fully described, elsewhere (McClelland 
and Winter, 1969). All we need concern ourselves with here is what was 
learned about how to produce the greatest improvements in subsequent 
performance of the participants. Somewhat to our initial disappoint- 
ment, we could not really conclude that any particular educational input 
was either absolutely essential or sufficient. Nor did any particular com- 
bination of inputs seem especially effective. Instead the simple con- 
clusion that could be drawn from a very complex series of training 
attempts was that the more different educational inputs were utilized, 
the greater the yield of the course tended to be. At this point it seemed 
useful to stop thinking about our training as if we were conducting a 
series of agricultural experiments in which wc would try to discover 
what combinations of fertilizers (educational inputs) would produce 
greater crop yields (improved performance). Instead we found it more 
helpful to think of our courses as if they were productions of a play in 
which various theatrical devices could be employed to create an atmo- 
sphere of expectancy, self-confidence, and commitment to future action. 
Thus, if one thinks of the effectiveness of a play in reaching the audi- 
ence, it seems somewhat irrelevant to test whether it would get across as 
well if it were doj;ie without liglits, or without dialogue, without a set or 
costumes, or perhaps even without acting as in a play reading. While 
such variables can be easily identified and introduced or left out, they 
somehow do not; appear to be the absolutely critical ones so far as 
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getting the play across is concerned. Thus it is entirely possible to have 
a very effective play reading, or pantomime without words, or perhaps 
even an entire drama acted out in the dark. Normally of course it is 
easier to produce an effect if all of the inputs-lights, costumes, set, 
dialogue, etc.— are present, which is exactly what we found, but it is also 
entirely possible to have all of these elements present and still produce a 
play wliich is a flop-which is also what we found. That is, we have had 
the experience of tryirig to put on courses where all of the inputs that 
we had identified were ''present, " yet the courses were clearly failures, 
even in the elementary sense that the participants left in disgust before 
they were over. 

It Wus at this point that we began to get seriously interested in 
educational technology. For educational technology should be helpful in 
selling the course to the participants, in creating at atmosphere which is 
conducive to learning and increased self-confidence, and in making the 
information to be presented more vivid and understandable. In fact, we 
had found it essential to make use of elements of educational technoU 
ogy from the very beginning, although it is only recently that we have 
begun to do so seriously with a self-conscious attempt to understand 
how and why they work. Thus for example, we concluded very early 
that set and setting could be cj'ute important in motivatiOr;jal learning. In 
very simple terms, we found that a strictly academic classroom setting, 
with the teacher lecturing and "pupils" writing out various exercises was 
certainly not as effective— at least for adult businessmen and certain 
types of disadvantaged pupils-as taking everybody out to a retreat set- 
ting in the country where they could be away from the distractions and 
boredom of everyday living and exposed to a new "total" environment 
which would put them in a better mood for self-examination and 
Chang:.. Or to take another simple example, when we wanted to teach 
people the principles of moderate goal setting, we found it nowhere near 
as effective to do this with paper and pencil tests as with a simple ring 
toss game in which each participant would have to get up physically and 
try to throw some rings over a peg under various varying drcumstances 
(alone, while others watched, with the possibility of a money reward 
and so on). In fact at this stage we found such participating exercises so 
useful in keeping up interest that we came to realize that many tradi- 
tional psychological tests could be used for training purposes. That is, 
psychologists have been extremely ingenious over the past fifty years in 
developing all sorts of tests of various skills, interests, attitudes, motives, 
and academic achievements. These may be fun for the tester and useful 
to him in the sense of predicting who is suited for one type of activity 
or another, but they are little fun for the testee because he doesn't learn 
anything from them. The information gathered on his behavior is to 
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help the tester make a decision, not to help the testae understand and 
improve his behavior. But obviously there is no reason why any testing 
device cannot be turned into a teaching device. Instead of keeping the 
information to himself, tlie psychologist can give it back to the testee. 
He can explain Iiow to get a better score on intelligence Kests by teach- 
ing the person to do belter on tasks that make up the I.Q. scale. He can 
explain how to react to Rorschach Inkblots in ways that show he has a 
well-organized approach to the environment. Or as in our training, he 
can help the participant write stories that score high for n Achievement, 
or help him set moderate levels of aspiration and respond realistically 
when he fails to achieve them. Under these new rules of the game, we 
have found that participants are fascinated with tests and will spend 
hours trying to understand how they work and what Sheir own behavior 
on them means. Thus in the most elementary sense, we have taken 
educational testing technology both from tlie experimental laboratory 
and from the personnel or clinical psychologist's t^st shelf and used it 
for training purposes. 

But obviously this is only a first and rather unsophisticated step. 
Such problems still remain as: why are such gamfts or tests so interesting 
to participants? How can their effectiveness be increased? What other 
types of educational technology can be invented or utilized to help 
develop motivation? It is in these areas that we are currently working 
and while we have no very hard data to present, at least we have 
developed some interesting new approaches based on our past experience 
that we believe are worth serious consideration. The easiest way to 
describe and demonstrate them seems to be to Vni them under the 
various functions which educational technology can perform, at least in 
theory, in developing motivation. 

Conveying information better. One of the oldest and simplest uses of 
educational technology is to present information simply, clearly and 
vividly so that people can understand it better. Not long after my book. 
The Achieving Society, was published in 1961, the American Psycho- 
logical Association under a grant from the National Science Foundation 
sponsored a film summarizing the major findings reported in the book- 
It is entitled "The Need to Achieve" and is available from the Audio- 
Visual Center at Indiana University. It is essentially an educational docu- 
mentary in which 1 tell the story of the research findings illustrated by 
various shots of experiments in progress showing the types of motivated 
behavior I am talking about. We often use the film in our training 
courses simply because it condenses a great deal of written material in a 
short period of time and provides a welcome alternative to the reading 
assignments which the participants in the courses are also given. 

In teaching the scoring system for n Achievement we have also found 
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a variety of visual aids to be holpful. For instance, the picture of a 
typewritten text cf the story enables the instructor to actually point to 
the phrases which are scored in a certain way. Or the various types of 
verbal imagery may be illustrated by pictures which show as vividly as 
possible what is meant, let us say, by a scoring category like "antici- 
pating a successful outcome of performance," In fact when we were 
giving the course to Arab farmers in a North African country, we were 
forced to rely entirely on pictures with oral explanations, because they 
were illiterate. 

These are fairly obvious ways of improving or "decorating" the mes- 
sage to be conveyed. Even more importantly the media may be used to 
show varieties of behavior that are not easy to describe verbally or to 
elicit in a classroom situation. For instance, in any given group of 12 to 
15 participants, it may turn out that no one will "grandstand" in the 
ring toss game. That is, no one may decide to stand as far from the peg 
as possible throwing wildly across the room in order to earn the smiles 
of the bystanders for being such a big risk taker or a big loser. Yet this 
is a type of behavior that is very important to observe in giving instruc- 
tions about goal setting and therefore it is useful to at least have a film 
or slide presentation of it so that the discussion of its meaning can take 
place realistically. Furthermore we often want to talk about how people 
display such goal setting behavior in real life as well as in game situa- 
tions in the training sessions. It may be easy for the group to see the 
analogy with the basketball player who keeps shooting from the center 
of the court but more difficult to understand how it would show itself, 
say, in the classroom in deciding what kind of questions to volunteer to 
answer or what kind of theme to decide to write. Again it is common to 
ask participants to bring examples from their own lives, but it is helpful 
in getting them started to present some scenes from everyday hfe that 
they can be asked to try to explain in terms of the goal setting prin- 
ciples they have just been practicing. In all of these cases, technology is 
used essentially to amplify, clarify, or improve the message which the 
teacher would normally try to convey by verbal explanations and per- 
haps some diagrams drawn on the blackboard. 

Arousing attention. When we first started designing our achievement 
motivation training courses for the schools, I visited a typical higli 
school classroom for the first time in over 35 years. What struck me 
most forceably— and of course I should have remembered it but I really 
hadn't-was the relatively small amount of time that the students were 
paying attention. The teacher was excellent. She was using the lecture- 
discussion method with points written on the blackboard from time to 
time to underline their importance. A few students near the front of the 
^ class seemed to be paying attention practically all of the time. A few 
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near the back, where it was hard to hear anyway, seemed not to be 
paying attention at all. And most of the students seemed to be paying 
attention only about half the time. The rest of the time they were 
drawing pictures, fiddling with their pencils or notebooks whispering or 
passing messages, or looking out the window. Yet this was by no means 
a disorderly classroom. In fact my impression is that it was fairly typi- 
caL So if you multiply the number of minutes in a classroom times the 
number of pupils in the room you come out with something like "pupil 
exposure minutes," and it is certainly not unreasonable to assume that 
the teacher's message was being attended to at most for half of those 
minutes. So a major problem in education-a much bigger problem than 
most educators, realize-is getting attention so that messages, no matter 
how clearly presented, will actually be received. In fact recent learning 
theory suggests attention is perhaps more important than that old stand- 
by in American psychology "reinforcement" or reward. Rewards, in 
fact, may simply be ways of getting attention which produces learning 
and there are of course many ways of getting attention other than by 
giving rewards. The problem is particularly acute with certain disadvan- 
taged groups or potential dropouts who are already "tuned out" to 
normal educational inputs. With them it is particularly vital to find some 
way of .getting their attention or they won't receive any of the educa- 
tional messages at all. 

For this purpose educational technology is particularly important. It 
has infinitely greater range than the average classroom teacher. Getting 
attention seems to be largely a function of exposing a person to stimuli 
which are moderately discrepant from expectation. That is, if what 
happens is fully expected, it is experienced as routine and boring. If it is 
totally unexpected, it is shocking, disorganizing and experienced as 
unpleasant. What maximally produces focused attention are events which 
deviate a little from prior expectation . ...^"something old something 
new . . ." Film strips, slide and light shows, movies, games, novel work- 
book exercises-all such techniques are ways of capturing the attention 
of students who are bored with more conventional ways of instruction. 
And we have used them all. As noted above, in some extreme cases we 
have found it better to remove course participants altogether from their 
familiar environments so that they may be "totally immersed" in a new 
situation in which all sorts of educational technology engage their at- 
tention from one end of the day to the next. Under these conditions we 
have found that we get a total involvement by the participants that 
most classroom teachers would really envy. 

We have prepared a media presentation on the ring toss game as an 
example of an approach that provides a certain amount of information 
and "grabs" attention. It is one thing to talk about various types of 
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performance in the ring loss game; it is quite another to experience 
those varieties vividly and personally in a series of constantly changing 
scenes presented by multiple slide projectors, overlaid with voices react- 
ing to various types of achievements. The hope is that every member of 
the audience will be grabbed personally by some scene or some com- 
ment, although our experience is that different people are grabbed by 
different stimuli. (Demonstration). 

Arousing and sustaining achievement motivation. The ring toss pre- 
sentation gets attention, and should provoke discussion, but media tech- 
nology offers other possibilities. It Is not only important to get atten- 
tion, but that is the sine qua non for receiving any kind of message; it is 
also desirable to do it in such a way as to arouse the desire "to achieve. 
Actually some of our earliest research dealt with arousing achievement 
motivation in college men by instructions telling them that we were 
testing their intelligence and leadership capacity. Thus we have long 
known that what people say can create an achievement-oriented atmo- 
sphere which increases the frequency with which people think achieve- 
ment thoughts. In fact we have long suspected that even the tone of 
voice with which an experimenter gives some standard instructions will 
affect how achievement oriented the atmosphere is because we once or 
twice ran across people who seemed not to be able to convey an 
achievement orientation to a group, even though they were saying the 
same thipr^s as other people who could convey it. More recently Klinger 
(1966) has shown that just watching an examiner who is present in 
front of a class but not saying anything can increase the frequency with 
which achievement-oriented stories are written by students in the room. 
If liis posture is erect and attentive, if he carefully erases the black- 
board, looks at his watch repeatedly, adjusts the shade on the window, 
etc., he can create an achievement-oriented climate that is reflected in 
the stores written by those watching him. On the other hand, if he sits 
down in front of the class, smiles, relaxes and liglits a cigarette there is 
very much less achievement imagery in the stories written by the stu- 
dents subsequently. In short we know how to make achievement more 
salient in a given situation at least temporarily. What we do not know 
yet is how to sustain an achievement orientation over a period of time 
or to make sure that it lasts after the training sessions are over. We are 
now experimenting with tapes of various kinds which not only present 
achievement images in vernaculars that our participants will readily 
understand, but in ways which will create achievement-oriented moods 
which hopefully will last beyond the short period in which the tape is 
presented. Our hunch here is that some of the non-verbal aspects of 
vocal communication are particularly important for stimulating the emo- 
tional experiences which seem to us to be central to getting people 
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permanently interested in doing better at the various jobs they under- 
take. There is a fair amount of evidence now that the emotional quality 
of a message is carried much more by vocal characteristics than by the 
words actually used. Thus, Milmoe and others (1968) have shown that 
emotions can be correctly recognized in such messages even when the 
words are filtered out in such a way as to make them unrecognizable. It 
is in this area that we hope to find clues for conveying the emotional 
and motivational aspects of our messages about achievement more ef- 
fectively. 

Stimulating fantasy. Part of our training lias always involved develop- 
ing a richer and more varied fantasy life. That is, since we argue that a 
motive in a sense is defined as an inner concern over doing well, we 
have sought ways of training people to develop fantasies of this type. At 
the simplest level participants are encouraged to write more vivid and 
dramatic :>tories in the achievement area. However, some people need to 
be ''opened up" or released from a rather conventional fantasy life. 
Three techniques have proved helpful. One involves presenting films that 
break out of conventioRal modes of thinking about objects, experiences 
or events. For instance, we have used a film on "Time" which shows 
how differently events are experienced if time is collapsed or expanded. 
Simply showing a film in slow motion illustrates the point in a very 
rudimentary way. More elaborate spectacles like the TV serial "Star 
Trek" or the film "2001" break through the bounds of time more 
dramatically. Or we have also used a film entitled "The Eye of the 
Beholder" which shows the same event from some half-dozen points of 
view apparently as actually experienced by the different participants in 
the event. The differences are in some cases so striking that it is difficult 
for the audience to figure out in the end exactly what did happen. Here 
technology is used essentially to loosen up the participants, to get them 
started thinking along new and different lines. 

Another approach is to bombard the participants with a wide variety 
of images of scenes, places and acts as in a light show. That is, once he 
is no longer thinking along conventional or routine lines, it may be 
helpful to provide him with some new images for thoughts that he can 
weave into his own fantasies subsequently. 

The audio-visual matrix you are about to see is intended to stimulate 
a variety of fantasies associated with the need to achieve, and also to 
arouse and sustain the psychological quality of achievement motivation. 
Although the program does provide a certain amount of information, 
"this is not its primary educational function. We were attempting to 
recreate the experience of achieving, rather than defining it or demon- 
strating its behavioral consequences. (Demonstration). 

Finally there is considerable evidence that fantasy is stimulated by 
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meditation and quiet. Maddi (1968, p. 435 tT,) has shown that monot- 
ony and boredom produce at least a passive need for novelty. Lerner 
(1967) has argued that the dream deprivation experiments demonstrate 
conclusively that there is a positive need to dream that must be fulfilledv 
When people are prevented from dreaming by being awakened whenever 
their brainwaves show signs that dreaming is beginning, they will make 
up for that lost dream time the next niglit that ihey are allowed to 
sleep without interruption. Thus, one can argue, as she does, that the 
quiet motionles.^ state of sleep promotes the kinesthetic type of dream- 
ing that is essential for normal living. It would seem to follow that 
sitting quietly and meditating in a relatively motionless state with mini- 
mal external stimulation should also facilitate f;antasy. Here again edu- 
cational technology can play a role in discovering what kind of total 
environment, including lights, sound, and visual imagery, produces the 
best kind of "meditation chambers." We have experimented with silent 
meditation in our training groups, although as yet little is known about 
the environmental conditions which promote it, except what is handed 
down from the traditions of various groups like the Quakers or other 
religious orders which practice it. In these traditions emphasis is placed 
on minimal stimulation of all types. Thus while at times we want liglU 
shows to suggest new fantasies, at other times, we want quiet to en- 
courage self-directed fantasy. 

Encouraging participation. A major objective of our motivational 
training is to get the person to assume the direction of his own life, to 
feel self-confident, to act like an origin rather than a pawn to use 
deCharms' vivid distinction (1969b). He must feel competent and self- 
reliant, capable of improving performance, ratlier than helpless, weak 
and uncertain as to how to cope with the overwhelnilng forces that push 
him around. So it is extremely important to get him out of his chair 
participating in various role playing situations or games in which he 
must generate spontaneously responses that will prove to him that he is 
in fact capable of acting without always being told what to do. So 
participants not only write their own stories, they score them. They not 
only observe other people playing the ring toss game, they have to 
commit themselves to throwing from one distance or another and ex-, 
plain afterwards why they made the choices that they did. They have to 
set concrete goals for their own lives and figure out ways in which tliey 
will be able to keep track of how closely they are achieving their goals 
after the course. In many ways they come to feel more confident pre- 
cisely because they feel they understand themselves better and have 
gained psychological insights through the experiences they have had that 
other people do not have. Thus they are in a better position to control 
and plan their own lives. 
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Educational technology in the form of games and exercises is ob- 
viously essential here. Films, slides and tapes can also help if they are 
used to elicit argument, to shock and disturb. However, as they are 
often used, they can create a problem by setting up an audience situa- 
tion in which everyone is a passive observer rather than an active partici- 
pant. That is, used in traditional ways, they may encourage passivity in 
the sense of: "Show me something new. I liked that one. What els< have 
you got up your sleeve?" It is a common observation that it is the 
people who make the slide shows, set up the equipment, worry about 
conditions of projection, take the pictures, edit the sound tapes, etc., 
who genuinely participate and probably develop some achievement mo- 
tivation in the process. Unfortunately the audience ordinarily does not 
participate. It just watches and listens. 

Educational technologists protest that it is not absolutely esse*itial to 
be passive in such situations. People can write on TV picture tubes, 
They can take their own pictures, cut and edit their own tapes and 
films, choose what chiannel to watch or listen to, what sequence of 
slides to show, etc. Nevertheless these things are normally not done and 
to date we have very httle success to report in this particular area. For 
one thing it seems to require a very expensive type of individualized 
instruction if the person is to genuinely interact with a tape recorder or 
a slide projector or a camera. Nevertheless we are making concerted 
efforts to develop some new approaches in this area because we feel that 
participation is so central to developing achievement motivation. In the 
meantime our classroom games and exercises and shows which arouse 
discussion perform this function very well. 

Making self-study easier. One of the advantages of educational tech- 
nology is that it can record a person's behavior so that he can observe it 
again afterwards or as many times as he wants to. At the simplest level 
he can write his own stories and then go back and code them for n 
Achievement. We have also experimented with sound recordings or video 
tapes of discussions that are played back the next day to give people an 
opportunity to analyze and understand more objectively how they were 
reacting. It is obvious that in the heat of the moment a person may be 
so focused on some aspect of the situation, such as expressing his dis- 
pleasure, that he may totally fail to notice what other people are doing 
or saying or perhaps even what kinds of expressive movements he him- 
self was making at the time. People are really interested in themselves. 
They normally, at least by the time they are adults, have a pretty good 
idea of what kind of a person they are. That is, they haVe learned to 
code their thoughts or actions in certain standard ways such as "I feel 
bad when people criticize me" or "I am usually a pretty cheerful per- 
son.''. Yet consistent exposure to their gestures, patterns of interactions 
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with others, or even the sound of their own voices as heard by an 
outsider ahiiost always injects new infomiation into the picture which 
forces the person to revise his opinions about himself. This kind of 
revision in the self-piclure is almost always essential if the person is to 
incorporate a stronger need to achieve into himself as a new concern 
which is [?oing to occupy more of his time in the future than it has in 
the past. To help give the person new information about himself, to 
break up his conventional ways of thinking about himself, it is essential 
to use educalional technology of some sort. 

Making available methods for devr^oping achievement motivation on a 
large scale... As a psychologist who has been in the business for over 
thirty years now, I am becoming more and more aware of how slowly 
psychological knowledge is disseminated to the public. As a young sci- 
entist, I held to the somewhat naive view that if psychologists ever 
happened to hit on something useful, "society" would naturally find a 
way of making it available to the public at large. Tve learned to become 
very skeptical about the transmission of knowledge in a useful form. 
The process of disseminatiou appears to be very slow and uncertain. For 
example, psychologists have known how to cure bed wetting in at least 
three-quarters of the cases for at least tlurty years and perhaps as long 
as 100 years. Yet there" are still hundreds of tho\isands of children 
suffering from bed wetting in the United States and hundreds of thou- 
sands of miserable parents who should be more than delighted to know 
abouV this technique. Yet it is not being adequately disseminated to this 
day. Pediatricians do not recommend its use for reasons that appear to 
be wholly without foundation. Here is a clear case where an important 
and useful bit of knowledge is simply not being adequately transmitted 
to the public (see McClelland, 1969). 

The state of our research knowledge about achievement motivation 
development seems somewhat analogous. We have conducted perhaps 
thirty or more training courses for groups as varied as Indian, Okla- 
homan or black American businessmen and high school dropouts, and iii 
nearly all cases there are significant improvements in achievement orien- 
tation and some aspects of performance. This seems to be a bit of 
psychological knowledge that ought to be useful to the public on a 
fairly large scale. Yet how is it to be disseminated? Certainly it does not 
seem possible for me to do much more along these lines, I am primarily 
a scientist, not a professional or businessman. There are still some very 
interesting research problems to be worked out in the motivation devel- 
opu.ent area, but in the meantime who is to get what we do know to 
the people who need it? This is by no means a trivial problem in social 
engineering. Jensen (1969) has contended, for instance, that even in the 
few cases where compensatory education hai succeeded in pilot projects. 
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efforts to apply it on a wider scale seem to have failed for the most 
part. One of the doubts that has plagued us all through the period when 
we have been running these courses has to do with whether our effects 
are somehow dependent on some very special characteristics of the train- 
ers involved. Does it in fact require some very special skills or psycho- 
logical insights to run these motivation development courses success- 
fully? If so, it might be quite impossible to expand the training much 
beyond the slow sponsoring of a few pilot courses much as we have 
been doing for the past four or five years. 

It is this problem which has led us to turn with some hope to 
educational technology. Certainly instructors will have to be trained to 
give these new types of courses but just as certainly they will not give 
them if they do not liave attractive, packaged materials available for use 
in giving them. In fact it is our view that having the materials available 
on an inexpensive basis will in fact encourage many more teachers to 
learn how to use them. The history of the development of technology in 
this country from typewriters to computers suggests that if a useful 
inexpensive gadget is available, people will learn to use it. It is for this 
reason that we have been collaborating with Educational Ventures, Inc. 
and Intermedia Systems Corporation to mass produce inexpensive edu- 
cational materials in modular form for achievement motivation training 
in the schools and business. You have in your hands a brochure describ- 
ing materials available for teaching achievement motivation in the 
schools prepared by Educational Ventures, Inc. (Middletown, Conn.) by 
special arrangement with our achievement motivation development proj- 
ect supported by the Office of Education. It is our hope that if prin- 
cipals and teachers learn that these materials are available and read what 
effects they have produced when used previously, they will find ways of 
getting people trained to use them. Actually of course, a number of 
teachers already know how to use such materials, but are inhibited from 
applying their knowledge more generally because, up to now, they have 
been supplied with materials by researchers who have no interest in 
continuing the courses once they have collected their data and gone 
home to write their research papers and monographs. This has left some 
teachers with copies of odd forms and exercises which they njight in 
theory duplicate and continue to use, but in practice we find that they 
do not, even though they are impressed with the success of their pre- 
vious efforts. We feel that making the materials attractively and inex- 
pensively available is one of the best ways to insure that this particular 
piece of psychological knowledge is more generally applied. 

But the courses should also not depend too heavily on superb teach- 
ers if they are to be widely used. Most school teachers simply cannot be 
expected to have superb psychological or social insight. They may not 



3 0 THE AFFECT! VE DOMAIN 



find it easy always to think of vivid and dramatic examples of achieve- 
ment-related thoughts or actions to discuss with the class. It is for this 
reason that we have been collaborating with Intermedia to help them 
produce the best kinds of tapes, slides, and films for supplementing or 
dramatizing the educational inputs necessary to produce increases in 
achievement motivation. Some educatitjnal technologists talK about 
making their materials "teacher-proof in the sense that no matter how 
bad the' teacher is the materials will somehow get tlie message across. We 
certainly do not aspire to have programs that will work without an 
instructor or with a poor instructor, but we do feel that it is important 
to provide the average instructor with the kinds of technology that will 
accomplish the goals listed above— that is, which will convey information 
simply and vividly, arouse attention, create and sustain an achievement- 
oriented mood, stimulate fantasy, encourage participation and make Jielf- 
study easier. For if we tliink of the motivational courses as a play and 
the instructor as the producer, his job will certainly be much easier if 
we provide him with a script, with costumes, with lights, with films, 
with slides and with tapes. He will still have to orchestr::te all of these 
educational aids into a meaningful production, but he should be in- 
finitely better off than if he had only his own voice and a blackboard. 
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During the past half-century, two ve^y different approaches or orien- 
tations to the discovery of psychological laws have emerged. The first of 
these orientations is concerned with general psychological processes that 
are found in all behaving organisms. The second emphasizes the study of 
individual differences in behavior. 

Psychologists who study general processes, tend to use experimental 
methods in which they manipulate selected variables and rigorously con- 
trol others. Such procedures permit them to test explicit hypotheses 
regarding the effects on behavior of specific changes in environmental 
condhions, and to formulate precise laws relating behavior to its ante- 
cedents. Psychologists who study individual differences are also viiter- 
ested in relationships between environmental factors and behavior, but 
their approach to psychological research does not usually involve experi- 
mental manipulation. These differential psychologists are concerned 
primarily with discovering correlations between already existing varia- 
tions in behavior and a wide range of environmental circumstances, not 
just those that can be manipulated. 

In his presidential address to the American Psychological Association, 
Cronbach (1957) discussed the divergence in goals and methods of 

^Tliis paper was presented at a Conference on ^'The Affective Domain in Learn- 
ing," held at Salishan, OregOii, March 23-26. The Conference was sponsored by 
Teaching Research, a Division of the Oregon State System of Higher Education. 
The research reported in Section IV was carried out in collaboration with Dr. 
Duncan N. Hansen and Mr. Harold F. O'Neil whose many cont;ibutions to this 
paper are gratefully acknowledged. 
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psychologists mainly concerned with general processes and those pri- 
marily interested in individual differences. He believed this divergence 
was so fundamental and profound that he entitled his address, "The two 
'disciplines of scientific psychology." In recent years, however, efforts 
have been made to combine and integrate these two approaches to scien- 
tific psychology. Such integrative efforts are perhaps most clearly re- 
flected in studies which have investigated the influence of individual 
difference variables on the learning process. 

Progress towards the unification of experimental and differential 
psychology in the learning area was assessed in a symposium on 'Learn- 
ing and Individual Differences' held in 1965 at the University of Pitts- 
burgh (Gagne, 1967). The compelling conclusion that follows from read- 
ing the papers presented at the Pittsburgh conference is that the inte- 
gration of individual differences with learning theory is, as yet, minimal. 
In his comments on these papers. Melton suggested a strategy which 
might be effective in bringing about the needed integration. According 
to Melton: "What is necessary is that we frame our hypotheses about 
individual difference variables in terms of the process constructs of con- 
temporary theories of learning and performance." (1957, p. 239) 

The major goal in, this chapter is to formulate hypotheses about the 
effects of individual differences in anxiety on the learning process. These 
hypotheses will be framed in terms of the learning constructs of a 
theory of emotionally based drive proposed by Spence (1958) and 
Taylor (1956), and tested in experiments on computer assisted instruc- 
tion. The paper will be divided into five sections. In Section I, the 
fundamental nature of anxiety phenomena will be considered in histori- 
cal perspective. In Section II, a trait-state conception of society will be 
described. Spence-Taylor Drive Theory and the empirical evidence sup- 
porting it will be briefly reviewed in Section III. In Section IV, experi- 
ments on the relation between anxiety and performance in computer- 
assisted leari.^ g will be reported. Finally, in Section V,- implications of 
research on anxiety and learning for the performance of school children 
in the classroom will be discussed. 

/. Theory and Res iirch on Anxiety 

Anxiety is regarded as a principal causative agent for such diverse 
behavioral consequences as insomnia, debilitating psyr'iological and 
psychosomatic symptoms, immoral and sinful acts, and even instances of 
creative self-expression.^ Recognition of the importance of anxiety as a 

^The research on anxiety and computer-assisted learning reported in this chap- 
ter vvas carri^^d out in collaboration with Dr. Duncan N. Hansen and Mr. Harold F. 
O'neil whose v ontributions to this paper are gratefully acknowledged. 
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powerful influence in contemporary life is reflected in the following 
passage from Time: 

Anxiety seems to be the dominant fact-and is threatening to 
become the dominant cliche—u ' modern life. It shouts in the 
headlines, laughs nervously at coi Ictail parties, nags from adver- 
tisements, speaks suavely in the board room, whines from the 
stage, clatters from the Wall Street ticker, jokes with fake 
youthfulness on the golf course and whispers )a privacy eacli 
day before the shaving mirror and the dressing table. Not 
merely the black statistics of murder, suicide, alcoholism and 
divorce betray anxiety (or that special form of anxiety which 
is guilt), but almost any innocent, everyday act; the limp or 
overhearty handshake, the second pack of cigarettes or the 
third martini, the forgotten appohitment, the stammer in mid- 
sentence, the wasted hour before the TV set, the spanked child, 
the new car unpaid for, (Time, March 31, 1961, p. 44) 

The current interest in anxiety phenomena has many historical ante- 
cedents. For example, a conception of fear or anxiety may be found in 
ancient Egyptian hieroglyphics (Cohen, 1969). James Krilzeck of the 
Department of Oriental Studies at Princeton notes a central concern 
with anxiety phenomena in the work of the medieval Arab philosopher, 
Ali Ibn Hazm of Cordoba. In a treatise entitled "A philosophy of char- 
acter and conduct,'' written in the 11th century A.D. Hazm states: 

I have conbvantly tried to single out one end in human actions 
which all men unanimously hold as good, and which they all 
seek. 1 have found only this: The aim of escaping anxiety. Not 
only have 1 discovered that all humanity considers this end 
good and desirable but also that no one is moved to act, or 
resolves to speak a single word, who does not hope by means 
of this action or word to release anxiety from his spirit. 
(Kritzeck, 1956, p. 573), 

Whatever the historical forerunners, it was Freud who first attempted 
to explicate the meaning of anxiety within the context of psychological 
theory. He regarded anxiety as "something feh"-a fundamental, un- 
pleasant emotional state or condition (Freud, 1924). This state, as Freud 
observed it in patients with anxiety neurosis, was characterized by "all 
that is covered by tiie word, nervousness, apprehension or anxious ex- 
pectation, and efferent (physiological) discharge phenomena/' Specific 
symptoms in anxiety states included heart palpitation, disturbances in 
respiration, sweating, tremor and shuddering, vertigo, and other physio- 
logical and behavioral manifestations. For Freud, anxiety was distin- 
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guishable from other unpleasant affective states such as anger or grief by 
its unique combination of phenomenological and physiological qualities. 
These gave to anxiety a special ''character of unpleasure." 

In his early theoretical formulations, Freud believed that anxiety 
resulted from the discharge of repressed somatic sexual tensions which 
he called libido. When libidinal energy was blocked from normal expres- 
sion, it accumulated and was automatically transformed into anxiety or 
into symptoms that were anxiety equivalents. Freud (1936) subse- 
quently modified this view in favor of a more general conception in 
which the functional utility of anxiety was emphasized. In his later 
theoretical conception, Freud regarded anxiety as a signal indicating the 
presence of a dangerous situation, and he differentiated between objec- 
tive anxiety and neurotic anxiety largely on the basis of whether the 
source of the danger was from the external world or from the indi- 
vidual's own internal impulses.. 

For Freud, anxiety was the "fundamental phenomenon and the cen- 
tral problem of neurosis" (1936; p. 85), and understanding anxiety was 
considered by him to be "the most difficult task that has been set us," 
a task whose solution required "the introduction of the rigl\t abstract 
ideas, and their application to the raw material of observation so as to 
bring order and lucidity into it" (Freud, 1933, p. 113). The complexity 
of this task and Freud's personal commitment to it are reflected in the 
fact that his theoretical views on the subject of anxiety evolved over a 
period of nearly 50 years, were continually modified, and were never 
regarded by him as complete. 

Clinical studies of anxiety' have appeared in the psychiatric literature 
with increasing regularity since 1894 at which time Freud first con- 
ceptualized anxiety neurosis as a discrete psychopathological syndrome 
to be distinguished from neurasthenia. Following Pavlov's discovery of 
experimental neurosis more than a half-century ago, there have been 
numerous experimental investigations of fear, frustration, and conflict in 
animals. In the past two decades, however, empirical research on anxiety 
has dramatically increased. During this period, more than 2,000 studies 
have been indexed under the heading "anxiety" in Psychological Ab- 
stracts, and over 3,000 studies have been indexed under "anxiety" or 
"anxiety-neurosis" in Excerpta Media and Index Medicus, Inasmuch as 
there is surprisingly little overlap between the psychological and medical 
literature, it seems safe to ijstimate that over 4,000 articles or books on 
anxiety have been published since 1950. 

While theory and research on anxiety have proliferated, this has not 
led to a consistent body of empirical findings, nor to convergence 
among theoretical interpretations. The distinguished scientists and clini- 
cians who have made important contributions to the understanding of 
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anxiety phenomena have, unfortunately, approached the problem of 
anxiety with their own unique theoretical perspectives and research ob- 
jectives (Spielb^ifer, 1966a). Consequently, despite tlie magnitude of the 
research effort, lack of agreement regarding the nature of anxiety, the 
particular stimulus conditions that arouse it, and the experiences tliat 
make individuals more or less vulnerable to it is still the rule rather than 
the exception. Indeed, our knowledge of anxiety today is not very dif- 
ferent from what it was in 1950 when Hoch and Zubin introduced a 
symposium sponsored by tlie American Psychopathological Association 
with the following statement: 

Although it is widely recognized that anxiety is the most per- 
vasive psychological phenomenon of our time and that it is the 
chief symptom in the neurosis and in the functional psychoses, 
there has been little or no agreement on its definition, and very 
little if any progress in its measurement. (1950, p. v) 

Given the prevailing interest in anxiety phenomena, and the extensive 
amount of empirical work that is being done, the need for a compre- 
hensive theory of anxiety is obvious. In the next section, a trait-state 
conception of anxiety is proposed as a theoretical framework for classi- 
fying existing knowledge of anxiety phenomena and guiding future re- 
search. 

//. State and Trait Anxiety 

Research findings suggest that an adequate theory of anxiety must 
distinguish conceptually and operationally between anxiety as a transi- 
tory state and as a relatively stable personality trait. It is also apparent 
that a comprehensive theory of anxiety must differentiate between 
anxiety states, the stimulus conditions that evoke these states, and the 
defenses that serve to avoid or ameliorate them (Spielberger, 1966a). In 
this section, two different anxiety constructs, state anxiety (A-State) 
and trait anxiety (A-Trait), will be defined. A trait-state theory of anxi- 
ety will then be proposed in which the relationship between these con- 
cepts is clarified. 

State Anxiety (A-State) may be conceptualized as a transitory emo- 
tional state or condition of the human organism that varies in intensity 
and fluctuates over time. This condition is characterized by subjective, 
consciously perceived feelings of tension and apprehension, and activa- 
tion of the autonomic nervous system. Level of A-State intensity should 
be high in circumstances that are perceived by an individual to be 
threatening, irrespective of the objective danger; A-State intensity should 
be relatively low in objectively nonstressful situations, or under 
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circumstances in which an existing danger is not perceived as threat- 
ening. 

Trait Anxiety (A-Trait) refers to relatively stable individual differ- 
ences in ahxLety proneness, that is, to differences in the disposition to 
perceive a wide range of stimulus situations as dangerous or threatening, 
and in the tendency to respond to such threats with A-State reactions. 
Persons who are higli in A-Trait tend to perceive a larger number of 
situations as more dangerous or threatening than persons who are low in 
A-Trait, and to respond to threatening situations with A-State elevations 
of greater. intensity. A-Trait may also be regarded as reflecting individual 
differences in the frequency with which A-States have been manifested 
in the past, and in the probability that such states will be experienced in 
the future. Anxiety scales which require individuals to report how often 
they have experienced symptoms such as "worrying" or diarrhea would 
thus appear to be measures of A-Trait. 

A major task for a trait-state theory of anxiety is to identify the 
characteristics of stressor stimuli that evoke differential levels of A-State 
in persons who differ in A-Trait. Atkinson (1964) suggests that a "fear 
of failure" motive is reflected in measures of A-Trait, and Sarason 
(1960) emphasizes the special significance for high A-Trait individuals of 
situations that arouse self-depreciating tendencies. On the basis of a 
review of the research findings obtained with various anxiety scales, 
Sarason concludes: 

. . . the bulk of the available findings suggest that high anxious 
5s are affected more detrimentally by motivating conditions or 
failure reports than are 5s lower in the anxiety score distribu- 
tion . . ..It is interesting to note that high anxious 5s have been 
found to be more self-deprecatory, more self-preoccuppied and 
generally less content with themselves than 5s lower in the 
distribution of anxiety ... it may well be that highly motivating 
or ego-involving Listructions serve the function of arousing 
these self-oriented tendencies. (Sarason, I960, pp, 401402). 

Experimental investigations of anxiety phenomena have produced 
findings that are generally consistent with Atkinson's suggestion that 
fear of failure is a major characteristic of higli A-Trait people, and with 
Sarason's conclusion that ego-involving instructions are more detrimental 
to the performance of high A-Trait individuals than persons with low 
A-Trait. In general, the experimental literature on anxiety appears to 
indicate that situations which pose direct or implied threats to self- 
esteem produce differential levels of A-State in persons who differ in 
A-Trait. 

Althougli failure or ego-involving instructions evoke higher levels of 
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A-Slate intensity in higli A-Trait subjects than in low A-Trait subjects, 
whether or not a particular high A-Trait individual will show an eleva- 
tion in A-State in a specific situation will depend upon the extent to 
which he perceives the situation as dangerous or threatening, and this 
will be greatly influenced by his aptitude and skills and by his past 
experience. For example, the requirement to perform on a different task 
may evoke high levels of A-State in most individuals with high A-Trait, 
but a high A-Trait person who has the requisite skills and experience to 
do well on a task is not likely to regard it as tlireatening. Conversely, a 
task or situation that most people would find nonthreatening might be 
regarded as extremely dangerous by a low A-Trait individual for whom 
it has special information regarding the probability that high levels of 
A-State will be aroused, the impact of any given situation can only be 
ascertained by taking actual measurements of A-State intensity in that 
situation. 

There is some evidence that persons with high A-Trait do not per- 
ceive physical dangers as any more threatening than do low A-Trait 
individuals. It has been observed, for example, that while threat of elec- 
tric shock produces significant increases in both self-report and physio- 
logical measures of A-State^ the magnitude of increase in A-State inten- 
sity produced by shock threat is unrelated to level of A-Trait as mea- 
sured by MAS (Katkin, 1965; Hodges and Spieiberger, 1966). 

In the Hodges-Spielberger study, Ss were also given a "Fear of Shock 
Questionnaire" (FSQ) which was included among a group of tests ad- 
ministered two month prior to the experiment. The FSQ consisted of 
the single item, "How much concern or apprehension would you feel 
about participating in a psychology experiment in which you received 
electric shock?" Subjects responded by rating themselves on a five-point 
scale from "none" to "extreme." FSQ scores were positively and signifi- 
cantly correlated with changes in heart rate produced by threat of shock 
(r = A3), and with level of A-Slate intensity as measured by tlie AACL- 
Today (r = .49). In contrast, no correlations were found between the 
F:5'Q and MAS scores, nor between the FSQ and changes in heart rate. 
Thus, subjects who reported greater fear of shock showed greater in- 
creases in physiological and self-report measures of A-State intensity 
when threatened with shock than those who reported little or no fear of 
shock, but threat of shock failed to produce differential increases in 
these A-State measures for persons who differed in level of A-Trait. 

A Trait-State Theoiy of Anxiety 

Tlie conception of anxiety presented in Figure 1 assumes that the 
arousal of A-State involves a process or sequence of temporally ordered 
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events. This process may be initiated by an external stimulus that is 
appraised by an individual as dangerous, such as tlie imminent threat of 
injury or death faced by a soldier in combat. Or it may be aroused by 
situations that involve psychological stress, such as the threat to self- 
esteem that is encountered in performing on a competitive task. 

Internal stimuli which cause an individual to anticipate danger may 
also evoke higher levels of A-State. For examplB, a student who sud- 
denly recalls that he has not prepared for a test that will be adminis- 
tered during the next class period is likely to experience an increase in 
level of A-State intensity. As previously noted, situations or circum- 
stances in which personal adequacy is evaluated are likely to be per- 
ceived as more threatening by higli A-Trait individuals than by persons 
who are low in A-Trait. However, the appraisal of a particular stimulus' 
or situation as threatening may be influenced more by idiosyncratic 
skills and past experience than by either the individual's level of A-Trait 
or the objective danger that is inherent in the situation. 

Once a stimulus situation is appraised as threatening, Trait-State 
Anxiety Theory (Spielberger, Lushene, and McAdoo, in press) posits 
that: (1) an A-State reaction v/ill be evoked; (2) the intensity of the 
A-State reaction will be proportional to the amount of threat the situa- 
tion poses for the individual; and (3) the duration of the reaction will 
depend upon the persistence of the evoking stimuli and the individual's 
previous experience in dealing with similar circumstances. The theory 
further assumes that througli sensory and cognitive feedback mechanisms 
high levels of A-State intensity will be experienced as unpleasant, and 
will serve to initiate cognitive or motoric processes that have effectively 
reduced A-States in the past. 

Stressful situations that are encountered frequently may lead an 
individual to develop effective coping responses that quickly alleviate or 
minimize the danger, thereby reducing immediately the intensity of the 
A-State reaction. A person may also respond directly to situations that 
are appraised as threatening with defensive processes that serve to reduce 
the intensity of A-State reactions. Two important classes of stressor 
situations can be identified which appear to have different implications 
for the evocation of A-States in persons who differ in A-Trait: 

K Circumstances in which personal adequacy is evaluated ap- 
pear to be more threatening to high A-Trait individuals than 
to persons with low A-Trait. 

2. Situations that are characterized by physical danger are not 
interpreted as any more threatening by high A-Trait indi- 
viduals than by those with low A-Trait. 

Accordingly, differential elevations in A-State would be expected, for 
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persons who differ in A-Trait only under circumstances that are charac- 
terized by some degree of threat to self-esteem. In situations that in- 
volve physical danger, however, no difference in A-Slate elevation would 
be expected for S% who differed in A-Trait unless, of course, personal 
adequacy was also threatened.^ 

With regard to the etiology of individual differences in A-Trait, it is 
assumed that residues of past experience dispose higli A-Trait persons to 
appraise situations which involve some kind of personal evaluation as 
more threatening than do individuals who are low in A-Trait. Wo may 
speculate that childhood experiences influence the development of indi- 
vidual differences in A-Trait and that parent-child relationships centering 
around punishment are especially important in this regard. The fact that 
self-depreciating attitudes are aroused in high A-Trait persons under' cir- 
cumstances chn.r,aclc;ized by failure or ego-involving instructions suggests 
that excessive cVitici'sm and negative appraisals from parents may have 
undermined the seif-coiifidence and adversely influenced the self-concept 
of these individuals. ... 

In summary, the schematic diagram that is presented in Figure 1 
provides a cross sectional analysis of anxiety phenomena. In this trait- 
state conception of anxiety, two different anxiety constructs, A-State 
and A-Trait, are posited and distinguished from the stimulus conditions 
that evoke A-States and the defenses that help individuals to avoid or 
reduce them. Thus, Figure 1 provides a conceptual frame of reference 
for classifying the major variables that should be considered in research 
on anxiety phenomena, and suggests some of tlie possible interrelation- 
ships among them. The classes of variable's that we believe to be most 
significant in anxiety research are: (a) the characteristics of stimuli, both 
external and internal, that evoke A-States; (b) the nature of the cogni- 
tive processes that are involved in appraising various stimuli as dangerous 
or threatening; and (c) the defense mechanisms that are employed to 
avoid A-States, or to reduce the intensity of these states once they are 
experienced. 

The State-Trait Anxiety Inventory 

The State-Trait Anxiety Inventory (Spielberger and Gorsuch, 1966; 
Speilberger, Gorsuch and Lushene, 1969) was developed to provide reli- 
able, relatively brief, self-report measures of both state and trait anxiety. 

^In many psychological experiments, threats of physical harm are confounded 
with threats to self-esteem. A subject may be told, for example, that lie will 
receive an electric shock if he does poorly on a task, or if his performance falls 
below a certain standard. 
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Four important characteristics determined the test construction strategy 
for the STAl: 

1. When the scale was given with instructions that required the 
subject to report his typical anxiety level ("Indicate how 
you generally feel'Oj eacJi individual item was expected to 
correlate with other anxiety scales that were widely accepted 
as measures, of individual differences in A-Trait, e.g., the 
Taylor Manifest Anxiety Scale and the IPAT Anxiety Scale. 
Each individual .VTrait item was also expected to be im- 
pervious to situational factors and relatively stable over time. 

2. When the scale was given with instructions that required the 
subject to report his present feelings ("Indicate how you feel 
right now''), each item was expected to reflect level of A- 
State intensity at that particular moment in time. Therefore, 
items were retained for the final scale only if they showed 
higlier means in a pnori stressful situations than in non- • 
stressful or nonthreatening situations. 

3. A third characteristic that vyas souglit in the STAI was high 
reliability in the measurement of both A-Trait and A-State, 
but particularly for the latter."* In evaluating the effects of 
various stressor conditions on level of A-State, the major 
int^irest is most often in, the differences obtained on two or 
more .occasions of measurement. Difference scores between 
any two occasions contain the error components of both the 
initial and final scores. Therefore, if the components of the 
difference score are only moderately reliable, the resulting 
difference score will itself be low in reliability, and thus 
insensitive to changes in A-State. 

4. To maximize its usefulness in psychological research, a 
fourth characteristic that was desired in the STAI A-State 
scale was ease and brevity of administration. In the investiga- 
tion of the effects of emotional states on performance, a 
long involved test would be unsuitable for many experi- 
mental tasks in which taking the test might interfere with 

^Since level of A-State should reflect transitory conditions that exist at the 
time of testing, tlie test-retest reliability of A-State measures would be expected to 
be relatively low. Consistent with this expectation, test-retest correlations for col- 
lege students retested on the STAI A-State scale after periods of one hour, 20 
days, and 104 days ranged frorfi .16 to .54, with a median r of only .32. In 
contrast, the alpha reliability of the STAI A-State scale for college students varies 
between .80 and .93. Given the transitory nature of personality states, measures of 
internal consistency such as alpha would seem to provide a more meaningful index 
of reliability than test-retest correlations. 
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performance on the task. Furthermore, a long test would be 
less sensitive to rapid fluctuation in the A-State. 

The A-State scale that was developed on the basis of these criteria 
consists of 20 statements that ask people to describe how they feel at a 
particular moment in time; subjects respond to each scale item (e.g., "I 
feel tense") by rating themselves on the following four-point scale: (1) 
"Not at all; (2) Somewhat; (3) Moderately so; (4) Very much so." The 
A-Trait scale consists of 20 statements that ask people to describe how 
they generally feel; subjects respond to each scale item (e.g., "I lack self 
cor. ience") by checking one of the following: (1) Almost never; (2) 
Sometimes; (3) Often; (4) Ahnost always. The State-Trait Anxiety In- 
ventory is comprised of these two self-report scales. Item selection pro- 
cedures and the item validation process for the STAI are described in 
detail by Spielberger and Gorsuch (1966) and by Spielberger, Gorsuch 
and Lushene (1969a). 

The STAI A-State scale evaluates subjective feelings of tension, ner- 
vousness, worry and apprehension. In developing this scale, it was dis- 
covered that such feelings were higlily correlated with the absence of 
feelings of calmness, security, contentedness and the like. Therefore, 
items such as "I feel calm" and "I feel content" were included to 
produce a balanced A-State scale: half of the items pertain to the pres- 
ence of feeling of apprehension, worry or tension, and the remaining 
items reflect the absence of such states. Thus, the STAI A-State scale 
defines a continuum of increasing levels of A-State intensity, with low 
scores indicating states of calmness and serenity, intermediate scores 
indicating moderate levels of tension and apprehensiveness, and high 
scores reflecting states of intense apprehension and fearfulness that ap- 
proach panic. 

It has been demonstrated tliat scores on the STAI A-State scale in- 
crease in response to various kind of stress and decrease as result of 
relaxation training (Spielberger, et ah, 1969). Further evidence bearing 
on the construct validity of the STAI A-State scale may be found in 
recent studies by Hodges (1967) and Taylor, Wheeler, and Altman 
(1968), and in the experiments that are reported in Section IV below. 
The relationship between anxiety and learning is considered in the next 
section. 

///. Anxiety and Learning 

Over the past two decades, much of the research on the effects of 
individual differences in anxiety on the learning process has been guided 
by a theory of emotionally-based drive formulated by Spence (1958) 
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and Taylor (1956). A detailed statement of the current status and em- 
pirical evidence supporting the Drive Theory was recently published by 
Spence and Spence (1966). The theory proceeds from Hull's (1943) 
basic assumption ■ that excitatory potential, E, which determines the 
strength of a given response, is a multiplicative function of total 
effective drive state, D, and habit strength,//. Thus: 

R = /(E) = /(DxH) 

Total effective drive stRte, results from the summation of all indi- 
vidual need states existent in a person at a given period in time, irrespec- 
tive of their source. The number and strength of the specific habits that 
are elicited in any situation u determined by an individuaPs previous 
experience in the same, or in similar situations. All habit tendencies that 
are evoked in a subject by a particular situation are multiplied by A 
Predictions from Hullian theory regarding the effects of variations in D 
on performance have been succinctly stated by Taylor:^ 

The implication of vaiyir^ drive level in any situation in which 
a single habit is evoked is clear: the higlier the drive, the greater 
the value of E and hence of response strength. Thus in simple 
noncompetitional experimental arrangements involving only a 
. single habit tendency the performance level of high drive Ss 
should be greater than that for low-drive groups. Higlier drive 
levels- should not, however, always lead to superior performance 
(i.e., great*?: probability of the appearance of the correct re- 
sponse). In situations in which a number of competing response 
tendencies are evoked, only one of which is correct, the relative 
performance of high and low drive groups will depend upon the 
number and comparative strengths of the various response ten- 
dencies. (Taylor, 1956, p. 304). ^ ' 

Drive Theory proper begins with the assumptions that noxious or 
aversive stimuli arouse a hypothetical emotional response, r^. The Taylor 
(1953) Manifest Anxiety Scale (MAS) was developed as an operational 
measure of individual differences in r^. It was originally assumed that 
scores on the MAS were positively related to characteristic differences 
among people in Tq and, therefore, reflected consistent individual 

^Taylor also notes that in tasks involving a number of competing response 
tendencies predictions concerning the performance of HA and LA subjects may 
require consideration of the HuUian concepts of oscillatory inhibition (O) and 
response threshold (L). While these concepts have been occasionally called upon to 
account for experimental findings in tests of Drive Theory utilizing complex learn- 
ing tasks, such explanations have generally been post hoc. Since neither O nor L 
have been given operational meaning in investigations of human learning guided by 
Drive Theory, these concepts will not be further considered here. 
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differences in D. The construct validity of tlie MAS as an index of D 
has been repeatedly demonstrated in classical conditioning experiments 
in wliich the UCS is typically a noxious stimulus (Spence, 1964). 

But verbal learning and concept attainment tasks do not generally 
involve noxious stimulation, at least in a physical sense. Evidence bear- 
ing on whether persons with high anxiety (HA) as measured by the MAS 
have higher D than low anxiety (LA) subjects when performing on such 
tasks is inconclusive. This led Spence to propose two alternative hypoth- 
eses concerning the relation between MAS scores and D: (a) The 
"Chronic Hypothesis" posits that HA 5s are more emotional than LA Ss 
and this causes them to manifest higlier D in all situations, whether 
stressful or not. (b) The . "Reactive Hypothesis" posits that HA Ss are 
more emotionally responsive than LA «!)S which causes them to react 
with higher D to situations involving some form of stress. 

Investigations of learning under neutral and stressful experimental 
conditions provide strong empirical support for the Reactive Hypothesis 
(e.g., Nicholson, 1958; Sarason, 1960; Spence and Spence, 1966; Spiel- 
berger and Smith, 1966), In these studies, differences in the perfor- 
mance of Ss who differed in anxiety as measured by the MAS were 
obtained only when the experimental conditions involved some form of 
psychological stress. The kinds of psychological stress that were espe- 
cially effective in producing performance differences which could be 
attributed to drive level were ego-involving instructions (e.g., 5s were 
told they were performing on an intelligence test) and failure instruc- 
tions (e.g., Ss were told they were doing poorly on an experimental 
task). 

Spence's Reactive Hypothesis may be interpreted in terms of Trait- 
State Anxiety Theory if it is assumed that individuals who are high in 
A-Trait, as measured by instruments such as the MAS, the IPAT Anxiety 
Scale, or the STAI A-Trait scale, tend to perceive situations that involve 
psychological stress as more threatening than do low A-Trait individuals. 
On the further assumption that A-State and drive level (D) are positively 
related, high A-Trait individuals would be expected to have higher D 
only in situations involving psychological stress. 

According to Drive Theory, th^ effects on performance in a learning 
task of individual differences in D depend upon the relative strengths of 
the correct and competing response tendencies that are evoked in the 
task. On simple tasks, in which there is a single dominant response 
tendency, or in which correct response tendencies *are stronger than 
competing responses, it would be expected that high D associated with 
high levels of A-State intensity would facilitate performance. On com- 
plex or difficult tasks, in which competing error tendencies'were numer- 
ous and/or stronger than correct response tendencies, high D associated 
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with higii A-State intensity would be expected to interfere with per- 
formance. These predictions are tested in the experiments on computer 
assisted learning reported in the next section. 



IV. Effects of Anxiety on Computer- Assisted Learning 

Most studies concerning the effects of anxiety on learning have origi- 
nated either in artificial laboratory settings or realistic but poorly con- 
trolled natural settings. Computer-Assisted Instruction (CAl) systems 
provide a convenient natural setting in which it is possible to evaluate 
the learning process under carefully controlled conditions with materials 
that are relevant to the real-life needs of the subject. Jn the studies 
reported below, the effects of anxiety on the learning process were 
investigated in a CAl setting. 
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Study f: The Effects of A-State on Computer-Assisted Learning 

This study investigated the relationship between A-State and per- 
formance for college students who learned difficult and easy mathe- 
matics concepts by computer-assisted instruction (O'Neil, Spielberger, 
and Hansen, 1969). According to S^jence-Taylor Drive Theory, it would 
be expected that the performance of higli A-State students would be 
inferior to that of low A-State students on tasks in which competing 
error tendencies were stronger than correct responses, and superior on 
tasks in which correct responses were dominant relative to incorrect 
response tendencies. With regard to the expected relationship between 
A-State and performance in the present study, it was hypothesized that 
students who were high in A-State would make more errors than low 
A-State students on the difficuh CAl task, and that this relationship 
would be reversed on the easy task. A unique feature of this study was 
that A-State measures were obtained while the students performed on 
the learning tasks. 

The subjects {Ss) were undergraduate students enrolled in the intro- 
ductory psychology course at Florida State University. The A-State scale 
of the STAI (Spielberger, et al, 1969) provided a self-report measure of 
the phenomenological aspects of A-State. Measures of systolic blood 
pressure (SBP) were obtained as indicants of the physiological com- 
ponent of A-State. SBP was measured by means of a desk model Bau- 
manometer. A CAl typewriter terminal controlled by an IBM 1440 
System (IBM, 1965) presented the learning materials and recorded the 
students' responses. The CAl program was written in a linear format 
using COURSEWRITER 1 (IBM, 1965), an author programmer language. 
The CAl program was composed of two main parts: a Difficuh Section, 
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which required Ss to prove the mathematical field properties of complex 
numbers, and an Easy Section, which consisted of problems about com- 
pound fractions. The programming logic required the S to solve each 
succeeding problem correctly before he could attempt the next one. The 
learning materials are described in detail by O'Neii, Spielberger and 
Hansen (1969). 

Two experimenters {Ei) supervised as many as eight Ss at the same 
time. The Ss were seated at CAI terminals located in a sound-deadened, 
air-conditioned room which the E% entered only to read instructions, 
administer the anxiety scales and take blood pressure. The experimental 
procedures were the same for all students and were divided into four 
main periods: Pre-task, the Difficult and Easy Performance Periods, and 
Post-tasks. During the performance periods, each S first progressed 
througli the difficult learning materials and then the easy materials. At 
the end of each period SB? was taken and the STAI A-State scale was 
administered. The possibility of systematic experimenter bias was mini- 
mized by insuring that neither E took a complete series of A-State 
measures for any single S. A brief four-item A-State scale was also 
presented during the task by the computer, and Ss were instructed to 
respond to it according to how they felt while working on the task. 

Results: The mean STAI A-State scores for the Pre-task Period, the 
two performance periods, and the Post-task period are presented in 
Figure 2. It may be noted that A-State scores increased from the Pre- 
task period to the Difficult task period, decreased in the Easy task 
period, and showed no change from the Easy task period to the Post 
task period. In a two-factor analysis of variance with repeated measures, 
only the Periods main effect was statistically significant. Individual t 
tests revealed that A-State scores were significantly higher m the Dif- 
ficult task period than in any of the other periods. There were no 
differences in the A-State scores of men and women. 

The mean SBP values, corresponding to the periods for which STAI 
A-State measures were available, are presented in Figure 3. It may be 
noted that SBP increased during llie Difficult task period, decreased 
during the Easy task period and showed little change from the Easy task 
period to the Post-task pivriod. In the analysis of variance for^ these data, 
the main effects for Sex and Periods were statistically significant, indi- 
cating that: (a) SBP for males was considerably higher than fc^r females; 
and (b) SBP showed changes over task periods similar to those^ obtained 
for the STAI A-State scores. For both men and women, SBP ^measures 
taken immediately after Ss performed on the Difficult task were signifi- 
cantly higher than ^n any other period. \ 

In the analysis of the error data for the Difficult and the Eiisy CAI 
tasks, each task was divided into two sections. For the Difficult task, 
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Figure 2. 



Mean STAl A-Sute scores obtained by students In the Pre-task and 
Post-task periods, and while they worked on the Difficult and Easy 
CAl learning tasks. 
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Figure 3. Mean systolic blood pressure obtained foi .nales and females during 
the Pre-task and Post-task periods and while students worked on the 
Difficult and Easy CAi learning tasks. 
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the first section consisted of five proof statements, Diff/(I-5), and the 
second section consisted of the remaining twelve proof statements, 
Diff/(6-I7). Similarly, for the Easy task, the two sections corresponded 
to the first five items, Easy/(l-5), and the remaining eleven items, 
Easy/(6-16). Brief A-State scales had been given by the computer be- 
tween the two sections of each task. 

The mean number of errors per problem for the first and second 
sections of the Difficult and Easy tasks are presented in Figure 4. It 
may be noted that the Diff/(l-5) section produced the most errors, the 
Diff/(6-17) section produced an intermediate number of errors, and that 
errors fell almost to zero in both sections of the Easy task. These data 
were evaluated in an analysis of variance in which the significant F ratio 
for tasks indicated that errors declined across the four periods. There 
were no differences in mean number of errors for men and women. 

No significant sex differences were found for either STAI A-State 
scores or errors. Therefore, in the evaluation of the relationship between 
A-State and errors, the data for men and women were combined. But 
separate analyses were carried out for the Difficult and Easy tasks be- 
cause there were significant differences between them in mean number 
of errors. For these analyses, the Ss were divided at the rnedian STAI 
A-State score obtained during each task. Subjects whose scores were 
above the median were designated the Higli A-State group; those below 
the median were designated the Low A-State group. 

The number of errors made by the High and Low A-State groups on 
the two sections of the Difficuh Task is indicated in Figure 5. High 
A-State 5s made nearly twice as many errors as the low A-State 5s on 
the Diff/(l-5) section, and they made fewer errors than low A-State 5s 
on the Diff/(6-17) section. An analysis of variance for these data yieldec*\ 
a significant A-State by Tasks interaction and a main effect of Tasks. 
There were very few errors on the Easy task and no statistically signifi- 
cant F ratios were obtained in the analysis of the error data for this 
task. 

To sum up, state anxiety increased when 5s worked on difficult CAl 
materials-. This pattern of change in A-State was observed for tlie 
20-item STAI A-State scales, for the brief A-State scales embedded in 
the learning materials, and for the SBP measures. While there were no 
differences in the STAI A-State scores for men and women, the SBP 
scores for males were significantly higher for males than for females. It 
is known that SBP is dependent upon physical characteristics such as 
L\^ight, weight and body build (Gregg, 1961). Since the males, on the 
average, were taller, heavier and more muscular than females, higher 
levels of SBP would be expected on the basis of these physical differ- 
ences. 
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Figure 4. Mean number of errors per problem for the two sections of the Difficult 
and Easy CAI learning tasks. 




Figure 5. Mean number of errors per problem made by students with high and 
low A-State scores on the two sections of the Difficult CAt task. 
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In Figure 5, it may be noted that tlie high A-Slate students made 
more errors than the low A-State students on Difr/(l-5) vvliereas low 
A-State students made more errors than high A-State students on 
Diff/(6-I7). On the assumption that A-State reflects drive level (D), the 
finding that performunce on the CAI task was an interactive function of 
level of A-State and Task Difficulty is consistent with the prediction 
from Drive Theory that the effects of anxiety on learning will depend 
upon the relative strength of correct responses and competing error 
tendencies (Spence and Spence, 1966). In the present study, A-State 
apparently influenced performance by: (a)- activating error tendencies on 
the initial section of the Difficult CAI task, for which error rate was 
relatively high; and (b) enhancing the production of correct responses on 
the second section of the DilTicult task, for which error rate was rela- 
tively low. • 

In contrast to the interactive relationship obtained between A-State 
and errors on the Difficult CAI task, no relationship was found between 
A-Trait and errors in this study. It should be noted, however, that in the 
statistical analysis of error rate as a function of A-Trait 5s were divided 
at the median of the A-Trait score distribution, rather than selected on 
the basis of extreme A-Trait scores as is customary in research on anxi- 
ety and learning. Thus, for high and low A-Trait students, the differ- 
ences in A-State (and the corresponding difference in D) may not have 
been large enougli to produce the expected differences in performance. 

Study II: State and Trait Anxiety and Computer Assisted Learning 

In this study ,^ subjects were selected on the basis of extreme scores 
on the STAI A-Trait scale and the order of presentation of the Difficult 
and Easy CAI tasks was counter balanced. In addition, nn IBM 1500 
CAI system was employed which made it possible to evaluate the gen- 
erality of the findings obtained in Study I with an IBM 1440 system. It 
Was hypothesized that high A-Tralt (HA) students would respond to the 
CAI tasks with higher levels of A-State than low A-Trait (LA) students, 
and that students who responded to the learning tasks with high A-State 
would make more errors on tlie more difKxult CAI materials and fewer 
errors on the easy CAI materials than low A-State students. 

The A-State and A-Trait Scales of the STAI (Spielherger, et al., 1969) 
were administered to approximately 1100 introductory psychology stu- 
dents. From this population, 80 males whose scores were in the upper 

^'Shidy II is described in greater detail in an unpublished paper presented in 
February, 1969, by 0*Neilj Hansen and Spielberger at the American Educational 
Research Association^ Meetings in Los Angeles. 
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and lower twenty per cent of the A-Trait distribution for the class were 
invited to participate in an experiment on computer assisted learning. Of 
the 44 Ss who were selected from this group, 22 had high- A-Trait scores 
and 22 had low A-Trait scores; these Ss were respectively designated the 
HA and LA groups. The CAI mathematics program used in tlie previous 
study (O'Neil, et al, 1969) was adapted for the present experiment by 
recoding the same learning materials in Coursewriter II (IBM, 1967). 

The learning materials were presented by an IBM 1500 CAI System 
(IBM, 1967). The terminals of this system consist of a cathode-ray tube, 
a liglU pen, and a keyboard. For each problem, the S selected the 
response he believed to be correct from multiple choices presented on 
the screen of the cathode-ray tube. He did this by pressing the light pen 
against a box that corresponded to the answer he considered correct. If 
the response was correct, the next problem was immediately presented; 
if the response was incorrect, the same problem was presented again. 
Since the display on the screen of the cathode-ray tube was removed 
after each response, information from previous responses was not avail- 
able to the subject. Thus, there was a greater memory load with the 
IBM 1500 system used in Study II than with the CAI typewriter termi- 
nal used with the 1440 system in Study I, and this produced a larger 
number of errors. 

The CAI system also presented the STAI A-State scales during the 
learning tasks and recorded the student's responses. Seven measures of 
A-State were obtained. Except for the pre-task A-State scale, which was 
given with standard instructions ("indicate how you feel riglrt now"), 5's 
were asked to respond to the A-State scales by indicating how they felt 
while performing on each preceding section of the learning task. The 
administrations of the A-State scales were programmed so that the order 
of item presentation on different occasions was random. 

The experimental procedures in Study II .were divided into three 
periods: (a) the Pre-task period, in which the 'students learned how to 
operate the CAI terminals; (b) the Performance period in which the 
computer presented the learning materials; and (c) the Post-task period 
in which students were interviewed and debriefed. These procedures 
were essentially the same as in Study I, except that blood pressure was 
not taken and the Easy and Difficult CAI tasks were presented in coun- 
terbalanced order. Each subject was assigned either to the D/E order, in 
wliich he progressed througli the Difficult task first and then the Easy 
task, or the E/D order in which the Easy task was followed by the 
Difficult task. 

Results: The mean STAI A-State scores for HA and LA Ss. on each of 
the three sections of the Difficult and Easy tasks are shown in Figure 6. 
The data as presented have been collapsed over task order since level of 
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A-State was approximately the same during the Difficult task irrespec- 
tive of whether it was given first or preceded by the Easy task, and 
A-State intensity in the Easy task was approximately the same when it 
was given either first or second. It may be noted in Figure 6 that: (a) 
HA 5s responded with higher levels of A-State than the LA 5s through- 
out the experiment; and (b) Level of A-State intensity increased from 
the Pre-task measure to Diff/A, decreased somewhat during Diff/B and 
Diff/C, and was relatively low in all three sections of tlie Easy task. 

Althougli there was a greater difference in A-State for the HA and 
LA 5s in the Difficult task than in the Easy task, the F ratio for the 
A-Trait by Task Difficulty interaction was not statistically significant. 
The main effects of A-Trait and Periods were significant, however, and 
further analysis of the Periods effect indicated that A-State was signifi- 
cantly higlier in the Difficult CAI task than in the Easy task. Tlius, 
A-State scores varied as a function of both A-Trait and task difficulty, 
but not as a function of task order, and higher levels of A-State were 
associated with the more difficult task. 

Since there were so few errors on the Easy CAI task, the relationship 
between A-State and errors was investigated only for the three sections 
of the Difficult task. In this analysis, the students were divided at the 
STAl A-State median obtained during Diff/A, which was 13. The mean 
number of errors per problem made by high and low A-State students 
on the three sections of the difficult task are presented in Figure 7A. It 
may be noted that high A-State students made more than twice as many 
errors on Diff/A than low A-State students, whereas there was relatively 
little difference in the error rate for high and low A-State students on 
Diff/B and Diff/C. 

The analysis of variance for these data yielded a significant A-State 
by Periods interaction similar to that obtained for these same variables 
in Study I. The data for Study I, in which Diff/B and Diff/C were 
combined, are shown in Figure 7B. In both studies, high A-State 5s 
made many more errors on the CAI materials presented earlier in the 
task than on the materials presented later in the task. In contrast, there 
was relatively little difference in the error rate for low A-State Ss on 
materials presented earlier and later in the learning task. A comparison 
of the results presented in Figures 7A and 7B also reveals that the same 
learning materials produced more errors when presented with the IBM 
1500 CAI system than with the IBM 1440 system that presented the 
learning materials in Study I. 

Althougli high A-Trait students in Study U had higlier A-State scores 
throughout the experiment, no relationship was found between A-Trait 
and errors. This was unexpected because A-State scores and errors were 
related, and A-Trait scores were moderately correlated with A-State. In 
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Error rates. (A) Mean number of errors per problem in Study fl on each of the three 
sections of the Difficult CAl learning task for students who obtained high and low 
STAl A-State scores during the first section of this task. {3) 'Mean number of errors 
per problem in Study \ on the Difficult CAl learning task for students who obtained 
high and low STAl A-State scores ors the first section of this task. 
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order to clarify the relationship between A-Trait and errors, the simul- 
taneous influence of A-Trait and A-State on performance was evaluated. 
For this analysis, the HA and LA groups were divided into high and low 
A-State sub-groups on the basis of whether a student's score was above 
or below the A-State median obtained in Diff/A. Approximately 25% of 
the higli A-Trait students had low A-State scores during Diff/A and a 
comparable percentage of low A-Trait students had higli A-State scores. 

The error data for HA and LA students whose A-State scores were 
consistent with their A-Trait scores are presented in Figure 8A; the data 
for the MA 'and LA students whose A-State scores were inconsistent 
with their A-Trait scores are presented in Figure 8B. It may be noted 
that the data in Figure 8A are generally quite consistent with the find- 
ings in the previous experiment (See Figure 7B); the HA/higli A-State 
students made more errors on materials presented at the beginning of 
the CAI task and fewer errors on materials presented later in the task 
than did LA/low A-State students. Thus, when A-State level was con- 
sistent with A-Trait scores, the familiar A-Trait by task difficulty inter- 
action was noted. 

Perhaps the most interesting findings in Study 11 are the error rates 
presented in Figure SB for students whose A-Stale scores were incon- 
sistent with their A-Trait scores. The error rate for LA students with 
higli A-State scores was over four times as great as the error rate for the 
HA/low A-State students on Diff/A, and remained higli on Diff/B and 
Diff/C. In contrast, the HA/low A-State Ss made fewer errors than any 
other group. 

In an effort to clarify- the data presented in Figure SB, measures of 
intellectual aptitude were obtained from university records. For those 
students who participated in Study 11 for whom aptitude scores were 
available, the median CEEB SAT (College Board) score for the LA/higli 
A-State students was just over 800, in contrast to median SAT scores of 
1050 to 1100 for students in the other three groups. Tlius, the low 
A-TrriH students who experienced higli levels of A-State intensity while 
•performing on the difficult CAI task were much lower in intellectual 
ability than their peers. 

To sum up, in the computer-assisted learning studies supported in this 
paper, higher levels of state anxiety were observed for students who 
worked on difficult CAI mathematics materials whereas level of A-State 
intensity for these same students was relatively low while they worked 
on easy materials. On the more difficuU mal:jrials, overall error rate was 
higli and students with higli A-State scores showed impaired perfor- 
mance relative to low A-State students. In contrast, higli A-State stu- 
dents made fewer errors than low A-State students on CAI materials for 
which there was a relatively low overall error rate. Thus, task difficulty 
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Figure 8. Error rates. (A) Mean number of errors per problem on each section 
of the Difficult CAI learning task for students whose STAI A-Staw 
scores on this task were consistent with their A-Trait scores. (B) 
Mean number of errors per problem on each section of the P'ffic.lt 
CAI learning task for students whose STAI A-State scopes • 
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influenced level of A-State intensity, and individual differences in A- 
State either impaired or facilitated performance, depending upon the 
overall error rate produced by the task. In general, these fmdings are 
consistent with Spence-Taylor Drive Theory and Trait-State Anxiety 
Theory (Spielberger, Lushene and McAdoo, in press). 

Although STAi A-Trait scores were relatively good predictors of level 
of A-State intensity, individual differences in A-Trail were unrelated to 
performance. For students whose A-Trait and A-Slate scores were con- 
sistent, however, higli A-State was associated with poorer performance 
on the more difficult part of the CAI learning tadc, and with better 
performance on the easier CAI learning materials. For students whose 
A-Trait and A-State scores were inconsistent, high levels of A-State in- 
tensity were especially detrimental to the performance of the LA/high 
A-State students, as may be noted in Figure 8B. These students have 
infrequently experienced anxiety states in the past and we may specu- 
late that they have not learned to cope effectively with such states when 
they occur. In contrast, the HA/high A-State students made more errors 
on the first section of the difficult task, but the performance of these 
students was ultimately superior to that of LA students. This finding 
suggests that HA students have had more experience than LA students 
in adjusting to anxiety states in the past and are tlierefore better able to 
cope with such states when tliey occur. 

V. Implications of Research on Anxiety and Learning 
for the Classroom Teacher 

What implications do the research findings on anxiety and learning 
have for the classroom teacher? To begin with, it is important for teach- 
ers to recognize that students respond emotionally to learning situations 
and that emotional reactions may either facilitate or impair performance 
(Spielberger, 1966b). Emotional reactions such as anxiety are likely to 
be more intense for difficult learning tasks than for easy tasks, particu- 
larly where there is an evaluation of the student's performance which 
may have some bearing in his future success. Since the evaluation of 
achievement is an essential activity in most educational settings, it would 
seem important for teachers to understand the nature of anxiety and 
how it influences learning and behavior. 

- Because anxiety is an unpleasant emotional state that often interferes 
with constructive behavior, some educators contend that there is no 
place for anxiety in the classroom. It is true that high levels of A-State 
may impair performance, particularly at the beginning of a difficult 
learning task, as was the case in our studies of computer-assisted instruc- 
tion. However, a moderate amount of A-State may actually facilitate 
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learning by helping a student to be more alert, and motivating him to 
try harder and persist in his efforts. Iii working with children in tlie 
classroom, teachers can help students to recognize that it is normal to 
be concerned about how well one will do on a difficult task. It is 
especially important for the teacher to be available to students as they 
begin to work on a new learning task because fear of failure and anxiety 
(A-State) reactions are likely to be greatest at such times. 

It is essential for the classroom teacher to realize that the emotional 
reactions of all students to a given learning task will not be the same. 
Anxiety reactions will depend upon the amount of personal threat that 
a specific task pO'Ses for a particular student. Because of fear of failure, 
some students (those with higli A-Trait) react to most learning situations 
as personally threatening. But whether or not a specific learning task or 
classroom setting will be regarded as tlireatening by a particular child 
will be determined by a host of factors. Among the most important are 
individual differences in intelligence, aptitude, or le'^rning ability, and 
past experience in similar circumstances. Tlie personality characteristics 
of the teacher may also be a critical factor for certain children, particu- 
larly those who are introverted, shy and higlily dependent upon adults 
for guidance and direction. 

Knowledge of the role of individual differences in learning will assist 
teachers to be more sensitive to the needs of individual students. Stu- 
dents who are hi^^i in anxiety proneness (A-Trait) will need more help 
at the beginning of a difficult learning task, but may do quite well after 
they have attained a degree of mastery of the task. WhOe students with 
low A-Trait ma> have less difficulty at the beginning of a learning task 
because they experience less intense levels of A-State, a low A-Trait 
student who lacks the ability to do well on the task may be over- 
whelmed with anxiety if it is important for him to succeed. However, 
once a low A-Trait student has achieved a certain degree of mastery of a 
task, he may require continual challenge in order not to lose inter^^t in 
his work. 

It is particularly important for teachers to be aware of die abilities 
and the limitations of their students. When a clald works on a difficult 
learning task for which he has little aptitude, the failure he experiences 
is likely to induce high kveis of state anxiety which will interfere with 
his efforts to master the task. Paradoxically ^ the student who is not 
higliiy disposed to experience anxiety will have Jhe greatest difficulty in 
situations that are perceived by him as threatening. Since he has less 
, experience in coping with anxiety, he is more likely to find k extremely . 
unpleasant and disruptive when it occurs. 

While it is not possible to avoid anxiety in the classroom, anxiety 
need not be detrimental to learning. The relationship between anxiety 
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and learning is exceedingly complex, and a great deal of research will be 
required in order to ascertain how best to help students cope more 
effectively with anxiety. This knowledge can be more readily obtained if 
psychologists and educational researchers collaborate with classroom 
teachers in seeking it. 
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Belief Systems and Education: 
Some Implications for Change 



O. J. Harvey 
University of Colorado 
Boulder, Colorado 

The goals of education, their means of attainment and the criteria by 
which both ends and means can be evaluated depend almost exclusively 
upon resolution of the question: "Education for what?" Answers to this 
question, historically and currently, are as varied as the breadth and 
specificity of the ideological commitments and values of the respon- 
dents. Yet one recurrent goal which seems to encompass many of the 
espoused educational objectives and to provide a great deal of consis- 
tency among theni is that of equipping the student with the necessary 
skills to live effectively and productively in the world of tomorrow. 
Disagreement is widespread and intense, however, both as to what these 
necessary skills are and the ways and conditions by which they may te 
developed and imparted. 

An attem.pt to specify the requisite skUls for coping with the future 
might appear futile or even meaningless since tomorrow is unknown, 
even unknowable, and thus is likely to present conditions which are 
uninterpreiable from our present modes of construal and to present 
problems insoluble by our present habits and techniques of solution. Yet 
these very conditions of uncertainty yield a wealth of information both 
as to the kinds of skills that are required to cope with the unknown and 

iMost of our own research referrec' to in this paper was carried oat under 
contract with The Group Psychology Branch of the Office of Naval R>.rearch, 
Contract Nonr 1147(07), which expired in 1968. My more recent research and 
writing, including preparation of the present paper, has been supported by a Re- 
search Development Award (Number 5-K2-MH-28, 117) from the National Insti- 
tute of Mental Health. 
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the kinds of practices and approaches that are irrelevant to and inconi- 
patible with solution of the unforeseen. 

Effective coping with the new and the unexpected precludes fixity 
and demands, among other skills, .the ability to withstand unceu.anty 
and stresSj to behave flexibly, to be committed with openness, to avoid 
over-generalization and to base decisions on empirically derived informa- 
tion instead of certitude based on opinionation. Our work has made it 
clear that individuals whose belief systems may be characterized as being 
more abstract are far more likely to possess such skills than persons 
whose belief systems are more concrete. Thus education, as one of its 
major goals, should push toward the discovery and establishment of 
conditions that foster the development of the student into an abstractly 
instead of a concretely functioning individual (Harvey, Hunt and Schro- 
der, 1961). 

Following a depiction of the general nature and function of belief 
systems, and how they .erve as different systems of motivation, I shall 
present some of the evidence on how belief systems differentially in- 
fluencR Mie way situations are interpreted and responded to, examine 
some of their developmental determinants and suggest some implications 
for education, especially for the problem of how belief systems may be 
changed through educational processes and the student be induced to 
function at the higher levels of abstractness. 

Nature and Function of Belief Systems 

A belief system represents a set of predispositions to perceive, feel 
toward 'and respond to ego-involving stimuli and events in a consistent 
way. As such, it r;perates as a kind of psychological filter which renders 
the individual selective in his ^''v^criminations, in what he attends to, in 
what he admits into and keeps out of his system, in what generates 
positive and negative affect within him and in the ways he responds 
toward certain bands or family of stimuH. Especially relevant for edu- 
cation, the person*s belief systems additionally mfluence the kmds of 
cues or guideposts on which one relies and utilizes in making his deci- 
sions. Hence one person, for example, may depend upon cues and 
symbols implying status and authority while another may rely more on 
information presented than on perceived attributes of the one making 
the presentation. 

The stress on ego-involvement should be noted. On the basis of con- 
siderable evidence we have come to assume that the different belief 
systems produce different effects only in relation to highly involving 
stimuli and that their effects are therefore minimal on stimuli that are 
Q affectively neutral marvey, 1967; Harvey & Felknor, 1968), This 
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assumption is consistent witli, perhaps even dependent upon, a second 
basic assumption which has to do with the acquisition of highly in- 
volving concepts or behefs: namely, that representatives of the more 
concrete belief systems acquire their more central beliefs through, a pro- 
cess of conditioning while representatives of more abstract systems ac- 
quire their more involving beliefs c.s products of inductive and insightful 
learning. This is meant lo that, as conditioned responses, the functioning 
of the affectively laden concepts of the concrete person is more under 
control of the autonomic system while the conceptual functioning of 
the abstract individual, even when affective concepts are engaged, is 
more under control of cerebral processes. The differential influence of 
the autonomic and cerebral processes on concrete and abstract persons is 
assumed to b5 the result of different developmental histories which pre- 
vent differentiation between and independent functioning of the cerebral 
and autonomic activities in the concrete person while allowing for separ- 
ation and autonomy of these sub-systems within the abstract individual 
(e.g., Harvey, 1967; Harvey & Felknor, 1968; Harvey, et ah, 1961). 

Belief systems, as we have come to treat them, differ both in content 
and structure, each representing a particular intersect between or pattern 
of content and the structural dimension of concreteness-abstractness. 
This is to say that a belief system at a given level of concreteness- 
abstractness also differs from the others in the content or referents 
which is focal or more central to it. 

Concreteness'Abstractness 

Of the many structural properties on which belief systems may be 
assumed to differ, our concentration, as irriplied above, has been on 
concreteness-abst:actness, a quality of how the individual articulates and 
organizes or diffeientiates and integrates his concepts of ego-involving 
content (Harvey, 1967; Harvey & Felknor, 1968; .Harvey, et al., 1961). 
Concreteness-abstractness, as we use the construct, refers to a super- 
ordinate conceptual dimension which encompasses a number of more 
molecular organizational attributes, such as degree of differentiation, 
extent of integration and centrality of the conceptual elements. Thus 
variation in concreteness-abstractness rests upon differences in patterning 
and organization and. not on differences in the algebraic sum of these 
subordinate characteristics. 

At the behavioral level, concreteness is manifested in a seemingly 
tight stimulus-response linkage, the extreme of which we have illustrated 
by the invariance of the moth flying taxically toward the light. More 
abstract functioning, on the other hand, due to its being based on a 
O „ more complex and enriched mediational system which allows departure 
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from the immediate properties of a stimulus, is reflected in less stimulus- 
response oughtness and greater relativism and freedom of thought and 
.action. From a wide variety of studies it has been, found that greater 
concreteness is manifested in a variety of ways, including: 

1. A simpler cognitive structure in regard to domains of high in- 
volvement (Harvey, 1966; Harvey, 1967; Harvey, Reich & Wyer, 1968; 
Harvey & Ware, 1967; White, Alter & Rardin, 1965; White & Harvey, 
1965). Thus when not ego-involved or affectively aroused the concrel'j 
person can see as many alternatives and make as many alternativeD and 
make as many distinctions among stimuli :\s the abstract individual. But 
under conditions of higli involvement and arousal the performance of 
the abstract person on tliese dimensions is much higher than ih.K of the 
concrete. 

2. A greater tendency toward more extreme, either-or and good-bad 
judgements (Adams, Harvey & Heslin, 1966; Ware & Harvey, 1967; 
White and Harvey, 1965). 

3. A greater reliance upon status and power than upon information 
and exper'.ise as guideHues to beliefs and judgements (Haivey, 1964; 
Harvey, :966; Harvey & Beverly, 1961 ; Harvey & Ware, 1968; Kritzberg, 
1965;Tiemann, 1965). 

4. A greater intolerance of ambiguity and uncertainty, expressed in 
higher scores on measures of authoritarianism and dogmatism and in the 
tendency to form judgements quickly of novel stimuli (Harvey, 1966; 
Reich, 1966; Ware & Harvey, 1967). 

5. A greater need for cognitive consistency together with a greater 
tendency toward negative arousal from the experience of inconsistency 
(Harvey, 1965; Harvey, 1967; Ware & Harvey, 1967). While the concrete 
individual extols the virtues of being consistent in his beliefs he is actu- 
ally unknomngly more inconsistent than the abstract individual but at 

^the same time he experiences more discomfort when Jhe inconsistency is 
made apparent to him. 

6. A greater inability to charige set and hence greater rigidity in the 
solution of complex and/or dianginp. problems (Felknor & Harvey, 
1963; Harvey, 1963; 1966; Reich, 1966). 

7. A greater insensitivity to subtle cues in the environment and 
hence a greater susceptibility to obtrusive clues even when they provide 
false leads (Harvey, 1966). 

S. A poorer capacity to "act as if," to assume the role of the other 
or to think and act in terms of a make-believe or hypothetical situation 
(Harvey, 1963; Harvey & Kline, 1965; Grabow & Harvey, 1968). 

9. Holding opinions with greater strength and certainty tliat the 
opinions will not change (Hoffmeister, 1965). 
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10. A higlier score on the factor of dictatorialness as reflected in 
such behavior as high need for structure, low flexibiUty, high rule orien- 
tation, high dictation of procedure, high frequency of the use of un- 
explained rules, and low encouragement of individual responsibility and 
originality (Harvey, White, Prather, Alter & Hoffmeister, 1966; Harvey, 
Prather, White & Hoffmeister, 1967; Coates, Harvey & White, 1968). 

11. A greater tendency toward trite and normative behavior and thus' 
a lower tendency toward ^novation and creativity (Brown & Harvey, 
1968; Harvey, 1966). 

12. A greater tendency to forhi and generalize impressions of other 
peopk* from highly incomplete inforn\ation (Ware & Hai.-:'. 1967). 

Greater abslraclness has been found to result in the opposite behavior- 
on the preceding dimensions. 

Four Specific Belief Systems 
General Description 

From the interaction of concreteness-abstractness witli ego-involving 
content a number of belief systems may be deduced. Although Harvey, 
et al., (1961) did infer and treat several such patterns of structure and 
content, my own major research effort has centered around the four 
summarized below. 

System I. This mode of construal and responding to the world best 
fits the descriptJon of concrete functioning presented earlier. 

System 2. This system, only somewhat more differentiated and inte- 
grated than System 1, differs in its representatives tending to distrust, 
reject and weigh negatively many of the cues, especially, those relating to 
establislied custom and authority, which are used as positive guidelines 
and signs of validity by persons of System 1 . 

System 3. Representatives of this system are more abstract, less 
dogmatic, less pro- or anti-establishment, and less evaluative than indi- 
viduals from either System 1 or System 2. At die same time they are 
more concerned with interpersonal harmony, empathic understanding, 
mutual dependencies and higlily developed skills of interpersonal manip- 
ulation aimed at averting social isolation, aloneness, interpersonal rejec- 
tion and f-^ilure when having to perform alone. 

System 4, This, the most abstract of the four systems, is charac- 
teitzed by higli task orientation, information seeking, low dogmatism, 
creativity (in the sense of offering S( \. ions to problems th;*t are higli in 
both novelty and appropriateness), penness to inputs from diverse 
sources and a high independence of judgement. 
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Measurement of Belief Systems 

We have developed two instruments specifically as measures of con- 
ceptual or belief systems. The 'This 1 Believe** Test, a "^emi-projective 
sentence completion test, has been used most extensively and success- 
fully. The Conceptual Systems Test is an objective scale more recently 
developed and much less extensively used and validated. 

The This I Believe (TIB) Test 

The TIB, developed specifically as a ineasure of conceptual or belief 
systems (e.g., Harvey, 1965, 1966; White & Harvey, 1965) re- 

que.sts the individual to indicate his beliefs about a number of socially 
and personally significant concept referents by completing in two or 

three sentences the phrase, 'This I believe about the blank 

being replaced successively by each of such referents as "religion,"' ''nicjr- 
riage/* ''friendship,** "the American way of life,** "sin,** "education,** 
"the family,** "compromise,** "capital punishment,*' and "world govern- 
ment,** With the aim of facilitating the production of spontaneous and 
uncensored responses, a two minute time limit, controlled by the ex- 
perimenter, is typically allowed for responding to each referent. The 
completions written by tiie subjects are evaluated with regard to several 
dimensions involving both structure and content. From the relativism, 
tautologicalness, novelty and connotative implication or richness of the 
completions, together with criteria implied in the earlier, cliaracteriza- 
tions of the four belief systems, respondents may be classified into one 
of the four principal bvilief systems posited by Harvey, et ah, (1961) or 
into some admixture of two. or more systems. 

Specifically, respondents are classified as representing System 1 if 
their completions denote such attributes as high absolutism, high tauto- 
logicalness, higli frequency of platitudes and normative statements, high 
ethnocentrism, higli religiosity, polarised judgements, and identification 
v/ilh the dominant American motif. 

Individuals are categorized as representing System 2 if in addition to 
being hig'ily evaluaiive and absolute they express strong negative atti- 
tudes toward such referents as "marriage,** "religron,** and others reflec- 
tive of the dominant American tlieme without giving much thought to 
the possible results of negating these referents or consideration of alter- 
natives. 

Responses to the TIB are scored as indicating System 3 funv;tioning if 
they ind'icate more relativism and less evaluativeness than Systems 1 and 
2 and at the same time express strong positive beliefs about friendship, 
people and general humanism and imply that friendship and/or people 
are a necessary and critical aspect of llvair existence. 



Belief Systems and Education 69 



System 4 functioning is inferred from the TIB responses that imply a 
high dcy/ee of novelty and appropriateness, independence without nega- 
tivism, high relativism and contingency of thought, openness to new 
information, the general use of multiple dimensions instead of single 
dimensions in their judgments and statements that are highly integrated 
and informationally loaded. 

The average interjudge reliability of TIB scorings, based on six speci- 
fic comparisons, has been .91, Test-retest reliabilities, within one week 
and after six months, each has been in the high .SO's. 

The Conceptual Systems Test (CST) 

The items in the CST were derived fium statements made by subjects 
in their completions of the TIB and from certain other tests purporting 
to measure personally aspects related to dimensions within the different 
belief systems. Factor analysis of each of eight revisions of the CST by 
Tryon's method of cluster analysis (Tiyon & Bailey, 1965) has yielded 
six highly consistet"' clusters. They, with some of their representative 
items are: 

1, Divine Fate ConU'ol (DFC) is assessed by such items as '4 believe 
that to attain my goals it is only necessary for me to live as God would 
have me live," "Marriage is the divine institution for the glorification of 
God," and *There are some things which God will never permit man to 
know." 

2. Need for Structure and Order (NSO) is inferred from such items 
as "I like to have a place for everything and everything in its place," '4 
like to have my life so arranged that it runs smoothly and without much 
change in my plans," and '4 like to plan and organize the details- of any 
work that I undertake." 

3. Need to Help People (NHP) is tapped by such items as '4 like my 
friends to confide in me and tell me their troubles," "Contributing to 
human welfare is th" 'ost satisfying human endeavor," and "I enjoy 
making sacrifices for the sake of the happiness of otlufs." 

4, Need for People (NFP) is measured by such items as "I like to 
join clubs or social groups," "I like to make as many fiiends as I can," 
and "I like to do things with my friends rather than by myself" 

5, Interpersonal Ag^ 'ession (lA) is assessed by such items as "I feci 
like telling other people off when I disagree with them," "I feel like 
getting revenge when someone has insulted me," and "1 feel like making 
fun of people who do things I regard as stupid " 

6. General Distrust (GD) is derived from such items as 'These days a 
person doesn't really know whom he can count on." "You sometimes 
can't help wondering whether anything is worthwhile anymore," and 
"Anyone who completely trusts anyone el;e is -sking for trouble," 
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The mean score of each of the four systems, as measured by the TIB, 
on each of the CST factors, conforms closely to the theoretical 
attributes described earlier. The CST can' be used in a variety of ways, 
including placement of respondents into the four belief systems, V/hen 
used for system classification, pre-established cut-off values are utilizt<i 
for each factor. On the basis of a great deal of empirical fitting, an 
individual is classified as representing System 1 if his mean score on 
Divine Fate Control is equal to or greater than 4.19. An individual is 
classified as System 2 if his mean score on Divine Fate Control is 4.19 
or less, his mean score on Interpersonal Aggression is 3.75 or more and 
his xnt^xi score on General Distrust is 3.39 or more. A person is clas- 
sified as representing System 3 if his mean score on Divine Fate Control 
does not exceed 4.19, his mean score on Interpersonal Aggression is no 
greater than 3.75 and his mean score on Need for People is 4.10 or 
more. A person is classified as representing System 4 if his mean score 
on Divine Fate Control does not exceed 4.19, hie mean score on Need 
for Structure-order is no more than 4.10 and his mean score on Inter- 
personal Aggression is 3.75 or less. 

Our experience so lar has been that classifying individual , as repre- 
senting one of the belief systems by use of the CST parallels quite 
closely the classification by the TIB for Systems 1, 2 and 3 but not so 
closely for System 4.^The superiority of the TIB over the CST in iden- 
tifying System 4 representatives is attributable, in our opinion, to the 
fact that the TIB is sensitive to both novelty and integration of re- 
sponses, each of which is weighted heavily in classifying an individual as 
representing System 4, while the CST, as it currently exists, measures 
neither of these factors. 

Given the preceding picture of basic differences in the construal and 
response tendencies of representatives of 'he different belief systems 
when viewed cross sectionally or in terms of present functioning, it 
jecomes important to examine the developmental determinants of these 
differences. An answer to the question kji how representatives of the 
different systems came to be the kinds of persons they are would have 
clear implications for anyone, including educators, concerned with pro- 
viding the necessary conditions of fostering change and growth in intel- 
lectual and self-development. As I shall try to indicate, the history of 
acquisition of belief systems must be taken into account if efforts at 
changing them are to be effective. 

In the next section some of the apparent determinants of the four 
belief systems will be examined briefly. Then some specific impHcations 
of these and the preceding materials for education will be suggested. 
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So?72e Developmental Determinants of the Four Systems 

In the original work of Harvey, et al., (1961) a variety of differences 
in developmental histories were posited among represtntatives of the 
four preceding systems. Most of these assumed differences center around 
childhood independence and the corollary issues of freedom of explora- 
tion and the locus and consistency of rewards and punishments. By 
focusing on these factors and considering behavioral differences among 
representatives of the different systems, such as tliose noted previously, 
it is possible to make some tenable deductions about their likely parent- 
child antecedents. 

For example, the findings that representatives of System 1 are more 
concerned with the public presentation of self and the living up to role 
and status definitions, have a higli need for cognitive consistency and 
the avoidance of cognitive imbalance and dissonance, believe more 
strongly and prevalently in divine fate control an J think and act in 
terms of discontinuous definitions of the world, would, together with 
other characteristics noted previously, lead to certain expectancies about 
the familiar genesis of such functioning. Among other things, the parents 
of a developing System 1 child should be expected: to present a united 
front to the world, including the child, and thus resolve interpersonal 
conflicts behind closed doors; to maintain an air of propriety toward the 
child and thus respond more aloofly in terms of status and role defini- 
tions than in terms of personal warmth and affection; to permit little 
diversity among family members in their beliefs about issues of high 
involvement, such as morality and religion; to stress religion and fre- 
quent church attendance; to use explanation sparingly and physical 
punishment frequently as responses to rule induction and violation; to 
reward consistently those behaviors which conform to the parents: 
standards with the result that adherence to the rule becomes rituahstic, 
an -end in itself rather than a means of achieving a superordinate goal; to 
instill the child '.vith the dominant American motif and to push him 
toward success in terms of these social criteria; to imbue the child with 
concern about reflecting socially unfavorably upon himself and his fam- 
ily; to distinguish poorly between the act and the actor and to praise or 
punish the actor instead of the act; and to behave discontinuously 
toward the child as a function of the latter's age, being hiphly restrictive 
and controlling when the child is young but more permisMve once the 
child has shown evidence of m-corporating the standards of the parent 
by behaving in accordance with these standards in a consistent way. 
Moreover, the father of a System 1 child is expected to be the more 
dominant parent in accord with the socially prescribed role. In addition, 
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because of his somewhat Spartan conception of manhood and his ac- 
ceptance of the traditional notion of the delicacy of womanhood, lie 
should make more demands of a son, be inore concerned with a son's 
success and failure in meeting the established standards and in general be 
more strict and punitive toward a son than toward a daughter. 

The parents of the developing System 2 child should be expected to 
manifest inconsistencies along a variety of dimensions, including rewards 
and punishments, the giving and withholding of affection, and in their 
responses toward importam. social norms and institutions; to leave the 
cliild ^.yith the feeling of being on his own not out of respec* for his 
ability but out of indifference; to evaluate his performance negatively 
without having previously ^ widod any clear indication of the criteria 
for evaluation; to make no effort to conceal the relatively frequent 
family discord; to give very little explanation to the child for the de- 
mands made of him; and to be punitive, controlling and capricious 
toward him. In addhion, it is quite likely that the father of a System 2 
child would be less dominant than the mother and less personally in- 
volver! in the day to day child reaihig. 

The mother of a System 3 child may be inferred to be similar to 
what has been described as overprotective (Levy. 1943). While reluctant 
to use physical punishment, she exerts tremendous control over the 
child througli a dependency reklionship coupled with overindulgence 
and the potential threat of love -withdrawal. The father may or may not 
behave similarly to the mother. But" if not, it is suggested tliat, rather 
than providing a balance or compensation for the behavior of the 
mother, the father displays a sort of indifference toward the whole 
matter and remains somewhat distant and affectionally isolated from the 
child and in so doing enhances the dependency relationship between the 
mother and the child. Probably both parents, but especially the mother, 
are thought to be very concerned with the social acceptance and the 
social achievements of their child as long as these do not endanger the 
mutual dependency bond between them and the child. 

The parents of the developing System 4 child should be expected to 
allow diversity of opinions without rancor; to encourage exploration of 
the physical world as well as of social values and assumptions; to foster 
independence while providing a basic '^ense of security; to treat the child 
as a person of intrinsic v/orth; to allow the child to choose his own 
goals and level of achievement; to use explanation frequently, to dis- 
tinguish between affect toward the child and evaluation of his act; to 
display consistency Without rigidity; and to be more equally involved in 
the definition and implementation of child rearing policy and practice. 

Until recently these assumptions of parent-child differences among 
repre'/entatives of the four belief systems remained more conjectural 
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than established, altliougli the ojie study that ' ad been carried out on 
this piobleni (Adams, Harvey & Heslin, 1966) had yielded results con- 
sistent with these assumptions. In a recent study Felknor and Harvey 
(1968) tvjsted most of these assumptions in some detail and confirmed 
most of them. Male and female college representatives of each of tlie 
four systems, selected by the "This I Believe" Test, each ccmpJeted a 
specially constructed Parent-Child Relationship Questionnaire (PCRQ) 
which was designed to assess several areas of parent-child relations, such 
as punishment, independence, approval, control, etc. With the aim of 
discovering possible changes or continuities in the relationships with 
changes in the child's age, many of the questions were repeated for 
three age levels, before the age of six years, age six to twelve and age 
thirteen to seventeen, age levels which were assumed to agree with the 
periods of early childhood, middle childhood and adolescence during 
which the role of the child would be undergoing changes. 

hi its fihal form the questionnaire consisted of 70 items: 62 dealing 
with parent-child interactions (e.g., frequency of punishment, type of 
reward, amount of dependence, approval of friends, etc.); six focussing 
on the relationship between the parents (e.g.. disagreement about goals 
for the child); and ^vo concerning church attendance. The 62 items on 
parent-child interactions were answered separately for mother and fa- 
ther, thus providing separate descriptions of the respondent's relation- 
ship whh each parent. Responses were made on either a six-point or a 
seven-point scale except for the questions regarding types of ■ punishment 
anrl reward which involved discontinuous alternatives and asked the re- 
spondent to check those which he recalled being used by his parents. 
For items which asked about the amount or degree of some trait (e.g., 
how strict), answers ranged from "extremely'' to "not at all.'' For items 
which, asked about the frequency of occurence of some phenomena, 
answers ranged from "always" to "never/' 

A ^'^ctor analysis of the responses by Tryon's method of. cluster 
analyi V (Tryon & Bailey, 1965) yielded 11 clusters each for mothers 
and fathers. 

T-he mother dusters consisted of (1) fairness and rapport, (2) variety 
of rewards before 6 through 17, (3) variety of punishment before 6 
through 17, (4) arbitrariness before 6 throu^ 17, (5) disagreement with 
father regarding the child, (6) strictness and control before 6 througli 
17, (7) freedom and independence before 6 through 12, (8) dependency 
on mother before 6 through 17, (9) concern with social impressions, 
(10) frequency of punishment before 6 through !^ and (11) warmth 
and approval. 

The father c) . liters were (1) fairness and^ respect toward child and 
suppoit for mother, (2) varsity of rewards before 6 throagh 17, (3) 
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variety of punishments before 6 througli 12, (4) arbitrariness before 6 
througli 12, (5) disagreement with mother regarding tlie child, (6) strict- 
ness before 6 through 12, (7) control before 6 through 12, (8) depen- 
dency on father before 6 through 12, (9) roncern with social impres- 
sions, (10) frequency of punishment before 6 through 12, and (li) 
strictness, arbitrariness and control 13 through 17. 

A variety of comparison's on these clusters as well as between such 
nomitial dimensions as kind of punishment and kind of reward basically 
cbnfirmed and extended the deductions outlined earlier concerning dif- 
ferences among representatives of the four systems in their relations 
they recalled with then parents. 

The picture gained of the different developmental conditions and- 
processes undergone by representatives of the different systems is con- 
sistent with the assumption outlined earlier that representatives of Sys- 
tems 1 and 2, especial'.y the former, acquire their concepts of higli 
involvement catechismically and as conditioned responses while repre- 
sentatives of the rnore abstract systems, particulady System "4, acquire 
their concepts, of L'oth higli and low affectivity, insightfully and induc- 
tively through exploration and direct experience. One significant implica- 
tion of this is that high affective arousal is more likely to impair the 
performance of concrete persons than of abstract individuals. Moreover, 
owing to differences in their developmental histories, representatives of 
the different belief systems should differ in ^h^ cues they use to validate 
a situation, in the kinds of persons tliey trust and are willing to rely 
upon or be influenced by, in wlio is an effective communicator or 
teacher for them, in the kinds of rewards and punishments to which 
they are receptive, and thus in the kinds of tasks and social conditions 
.that are likely to produce sub-optimal, optimal and super-optimal 
arousal for maximum achievement. 1 will later present in some detail the 
results of certain of our studies that bear directly on these questions. 

Some Educational Implications 

Teacher's' Belief Systems, Classroom Atmosphere and Influence on 
Studems 

Probably the most crucial determinant of the classroom environment, 
jand thus of the learning conditions surrounding the students, is the 
behavior of the teacher and the atmosphere she produces. In turn, her 
behavior, the resulting classroom atmosphere and the influence she has 
on her students are all influenced heavily by the nature of her beliefs. 
Of the several studies we have carried out on this general topic, two, 
because of their relevance to this conference, will be reported in some 
jet ail. 
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in the first of tliese studies (Harvey 'Vhite, Prath(jr, Alter & Hoff- 
meister, 1966) concrete and abstract {qul. ^rs of kindergartners and first- 
graders v/ere observed in the classroom and rated by pairs of trained 
judges Oil 2b dimei^sions assumed to reflec; attributes relevant to the 
fosteri'.ig of flexibility, adaptability and creativity in children The rating 
categories were: (1) expression of warmth toward the c]iildren, (2) per- 
ceptiveness of the children's wishes and needs, (3) flexibility in meeting 
the needs and interest of the children, (4) ability i.o maintain relaxed 
relationships with the children, (5) atten^'on to the individual child, (6) 
task involvement, (7) enjoyment of teaching, (S) enlistment of child 
participation, (9) encouragement of individual responsibility, (10) en- 
couragement of free t!xprei.iion of feelings, (11) encouragement of crea- 
tivity, (12) teaching new concepts, (13) ingenuity in improvising teach- 
ing and play materials, (14) utilization of physical resources, (15) task 
effectiveness, (16) diversity of activities simultaneously permitted, (17) 
smoothness of classroom operation (especially in the transition from one 
activity to another), (18) consistency of rule enforcement, (19) use of 
functional explanation of rales"; (20) use of u^explair'jd rules, (21) rule 
orientation, (22) determination of classroom and playground procedure, 
(23) need for structure in :^.eaching activities and relationships with 
cliildren, (24) punitiveness, Knd (25) anxiety induced by observers' 
presence. 

Teachers representing System 4 differed from representatives of 
Systef, I in what was presumed to be the direction favoring adaptabiJity 
and flexibility on all 26 dimensions. 

In addition, the 26 dimensions were factor analyzed and three major 
factors extracted: teacher r?^sourcefulness, dictatorialness and punitive- 
ness» System 4 te.ichers were more resourceful, less dictatorial and less 
punitive than System 1 teachers. 

After having demonstrated in the preceding study that concreteness- 
abstractness of teachers' belief systems influence the kind of classroom 
environments they create, a study was carried out to assess ^he influence 
of teachers' beliefs and behavior upon the performance of their -students. 
In the second smdy (Harvey, Prather, White & Hoffmeister, 1968) con- 
ciete and abstract teachers of kindergarten and first-grade were again 
rated by a trained observer on the same rating scale as above. In addi- 
tion, *he students were rated on the following 30 performance dimen- 
sions: (1) overall .adherence to the teacher's rules, (2) immediacy of 
response to the rules, (4) information seeking, (5) independence, (6) 
cooperativeness with the teacher, (7) task attentiveness, (8) enthusiasm, 
(9) voice in classroom activities, (10) voluntary participation in class- 
room activities, (11) free expression of feelings, (12) diversity of goal 
relevant activities, (13) student-initiated activity, (14) amount of ac- 
tivity, (15) considerateness toward classmates, (16) reciprocal affection 
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between (.'ussmates, (17) cooperation with classiv^atcs, (IS) taking turns 
with classmates, (19) amount of interaction with classmates, (20) nov- 
elty of response to problem or teacher's question, (21) appropriateness 
of response, (22) accuracy of facts, (23) integration of facts, (24) orien- 
tation toward specificity of facts (vs. more general principles), (25) rote- 
ness of answers jr solutions, (26) active hostility towa;d the teacher, 
(27) passive hostility toward the teacher, (28) aggressioi. toward class- 
mates, (29) guidance seeking, and (30) approval seeking. ' 

In addition to replicating the results of the first study (Harvey, et al., 
1966), the second study ilso found students of concrete and abstract 
teachers to be differentially influenced m the ways anticipated. A factor 
analysis of the 31-item student rating scale yielded seven factors, termed 
(1) cooperation, (2) student involvement, (3) activity level, (4) nur- 
turance seeking, (5) achievement level, (6) helpfulness, and (7) con- 
creteness of response. Students of more abstract teachers, in comparison 
to their counterparts, were more cooperative, more involved in class^ 
room activities, more active, higher in achievement, more helpful, lower 
in nurturance seeking and less concrete in tlieir responses. 

Clearly, then, teachers' belief systems affect both the way they be- 
have in the classroom and the influe'ice they exert upon tlieir students. 
In addition, the results of the two preceding studies, which recently 
have been replicated and extended (Coates, Harvey & White, 1969), 
point stiongly toward the hypothesis that to produce open, flexible, 
adap'nve and creative students it is necessary, among other things, to 
first have abstract teachers. 

At the same time, however, other of our findings make it clear that 
the goal of filhng the classrooms with abstract teachers is not a realistic 
one within the foreseeable future because currently only a small per- 
centage of teachers (approximately 7 per cent) appear to be functioning 
at the level of System 4 while a large majoriiy represent clear System 1 
functioning or an admixture of System 1 with System 3. Moreover, the 
majority of superintendents, principals and student teachers whose belief 
systems have been assessed have also been found to represent predom- 
inantly System I functioning (Moellenbevg, 1966; LeMarr, 1968; Dahms, 
1969). It might be added as an interesting aside that of the several 
hundred active teachers we have studied in Colorado a clear represen- 
tative of System 2, the anti-establishment orientation, has yet to be 
found. This presumably is the result of a chain of events, starting with 
selection of students to become teachers, teacher v:,,:. ir^ipg prac- 
tices and attrition due to disparity between the ori;;.ii-.- viLM i System 
2 representative and the constraints seemingly imposed by most school 
administrations. 

It should be noted that my emphasis upon the teacku as the crucial 
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instrument for inducing abstractness in students runs somewhat counter 
to tlie widespread effort currently underway of attempting to improve 
education primarily through innovations in met'.od and curriculum. 1 do 
not wish to speak against the efforts at curriculum innovation; but I do 
wish to indicate a strong belief, based upon what I think is evidence, 
that curriculum techniques and method interact with the belief system 
and style of the teacher, the result being that a particular kind of 
curriculum o'r method may be /ery effec. /e as practiced by one teacher 
and be a dismal failure in the hands of another. One of the more 
distinct impressions we have gained from the observations of several . 
hundred classrooms is that the System 4 teacher is innovative and im- 
provising in materials, resources and approaches to teaching while repre- 
sentatives of System 1, even when provided with abundant physical 
resources and equipment, still behave dictatorially and in ways that re- 
strict the freedom and exploration of the students. 

Obviously, were I to follow my inclination, I would at this point 
move toward demonstrating the importance of teacher selection, training 
and retraining as a means of enhancing abstractness i.r '.'dents. How- 
ever, since these are I road areas in and of themselves and are not ac- 
cessible to immediate solution, I will examine the possible use of other 
means in inducing abst-actness among students. 

Modify i',.g Belief Systems Toward Greater Abstractness 

Since adaptability, flexibility, creativity and general conceptual open- 
ness are characteristics of more abstract functioning, especially System 4 
activity, it follows that if a certain level of abstractness were achieved 
by the student the corollary charac* vnstics would tend to follow. The 
question then becomes: How can an ' dividual functioning at some level 
lower than System 4 be induced to change in such a way that he can 
achieve System 4 functioning? The answer probably is that different 
methods and approaches muot be used for each of the less abstract 
Systems 1, 2, and 3. Before dealing specifically with this question, 
, however, two kinds of change, and reciprocally two bases of resistance 
to change, need to be explicated. . 

Defensiveness and Ignorance. As Bases of Resistance to Change 
In those instances where an individual is ignorant simply because of 
lack of information, i.e., his failure to know and understand something 
is due to not having been exposed to proper information at a strategic 
moment in his life span, and not to defensive and distortion processes 
stemming from prior sets, commitments, evaluative and interpretive 
tendencies, information will tend to suffice to produce the desired 
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change. But it must be noted that for information to be received and 
processed* effectively implies an open system^ one by which its possessor 
is not driven to ward off the r.ovel and the different or to process the 
information according to rigidly defined categorUr.. 

Our research has indicated clear differences among icpreser.tatives of 
the concrPt-3 a^^d rhstiact K'Mef systems in the extent to which they can 
make discriminations and efioctively process informational inputs under 
cond'*ions of high involvement and aroubal. As indicated in tlie earlier 
disLuasion of t developmental determinants of the four belief systems, 
these differences miglU be attributable to the diffe- ^n-ial operation of 
the autonomic and cerebral processes witliin the concrete and the ab- 
stract, "'ndividual. This is based on two assumptions, (1) that the more 
central beliefs of the concrete person were acquired pretty much as 
conditioned responses while those of the abstract individual are acquired 
more as inductive and insightful concepts and that (2) consequently the 
autonomic and central processes within the concrete person are undif- 
ferentiated, but differentiated and independent within the abstract per- 
son. Thus, it is hypothesized, involvement and arousal within the con- 
crete individual results in domination by the autonomic system and an 
inability to cerebrally and informationally process inputs while involve- 
ment and autonomic activity witinn the abstract person does not readily 
interfere with his cerebral functioning and information processing.' 

Differential Effects of Arousal 

In a recently reported study, Harvey, Reich and Wyer, (1968) in 
vestigated the differentiation of concrete (Systems 1 and 2 combined) 
and abstract individuals (Sysiicms 3 and 4 combined) on two measures 
under three levels of involvement in the stimuli being differentiated. 
When judging stimuli toward which they we»-e low in involvement, the 
concrete subjects made more differentiations both within and amor,g 
those siimuli than did the abstract individuals. But under heightened 
involvement, at both the middle and higli intensity levels, the reverse 
was the case. As e summarized these results, "the concrete subjects 
achievedf their highest scores on belli measures of differentiation when 
their attitudes toward stimuli were least intense and decrease their per- 
formance rather rapidly as the intensiiy of their attitudes increased. The 
diflorentiation of the abstract subjects on both measures was similar at 
all three levels of attitudinal intensity (p. 477).** These results were 
interpreted as being "consistent with the assumption^ concerning the 
developmental histories of these individuals . . . Concret>i individuals pre- 
sumably have a high level of arousal condinoned to stimuli about which 
they report intense attitudes. The rating of these stimuli may elicit this 
arousal which impairs their differentiation. On the other hand, abstract 
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persons either do not have conditioned emotional responses to stimuli 
toward which they have intense attitudes, or their differentiation is not 
impaired by arousal (p. 477)." 

A study just completed and in the process of being reported by 
Grabow and Harvey (1969) obtained results similar to the preceding 
ones, although a different measure of arousal, namely Spielberger's t^st 
of state anxiety was employed. Spielberger's test was administered to 
Introductory Psychology students under the instructions that their o; >. 
in the course would depend partially upon their performance on ;/.e 
dependent variables which consisted of parts of the Wechsler Adult 
.Intelligence Scale, Vocabulary, Arithmetic and Digit-Symbol Substitu- 
•£ion, and a role playing task in which the subject was required to pre- 
sent in writing his arguments both for and against the American way of 
life. In the analysis representatives of Systems 1 and 4 were divided, by 
the median split, into Higli and Lo\ Anxiety groups. On all seven de- 
pendent variables (four role playii^g jind three intelligence variables) 
except Digit-Symbol Substitution System 1 representatives decreased 
their performance under increased anxiety while System 4 individuals 
increased theirs. Thi? was especially the case for performance on the 
Vocabulary test. On the Digit-Symbol Substitution Task representatives 
, of both systems decreased their performance under heiglitened an. iety. 
These results are being interpreted to mean that the central processes of 
System 1 subjects were impaired by anxiety while they tended to be 
facilitated for- abstract individuals. The reversal for the abstract subjects 
. on Digit-Symbol Substitution possibly may be -attributable to the in- 
volvement of a motor task on which they too were impaired by anxiety. 

A third study that relates to the two immediately preceding] ones and 
also suggests some of the social conditions that may impair or facilitate 
the performance of the representatives of the four systems was reported 
by Harvey in 1963. Representatives of each of the four belief systems 
played a role which involved arguing against their own stand on the 
target issue (i.e., whether or not philosophy should be required as a 
minor for all undergraduate college students) under either an adonynious 
or authority suneillance condition. Under th? anonyi].ous condition sub- 
ject9. were assvired that no one, including the experimenter, would ever 
hea. (heir tape-recorded arguments, which although erased by the sub- 
ject himself were also recorded surreptitiously by the experimei)ter> 
Under authority surveillance, however, subjects were cautioned to not 
erase their tape-recorded arguments as they played them back to them- 
selves since the tapes were to be turned over to a university curriculum 
committee that was currently reviewing the whole general question of 
undergraduate minors. 

Predicted main and interactional effects were obtained. Performance 
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was higliCi under the anonymous than under the surveillanoc condition 
and System 4 representatives outperformed representatives of the other 
systems under both conditions. Of greater relevance to education pc* 
haps were the interactive effects, especiahy the striking difference in die 
performance of ^--t^m 2 individuals under the two coniitions. When 
performing anonymously, these ind'^'iduals consistently out-performed 
System 1 subjects, achieved higher scores on several of the role playing 
dimensions than did representatives of System 3 and performed almost 
as well as System 4 indi^^'duais in several instances. Under the authority 
surveillance condition, however, the performance of System 2 subjects 
became the worst of the four conceptual groupings. 

A study that has bearing on some of the issues raised by the role 
playing study (Har/ey, 1963) was conducted by Brown and Harvey 
(1968). Higli school representatives of the four belief systems were ad- 
ministered a battery cf creativity tests by a faculty member of the 
scliool who pointed out that no consequences would derive to the stu- 
dents from their performance on the tests. W.iereas System 2 college- 
students had performed almost as well as System 4 individuals on the 
creativity aspects of the role playing under the anonymous condition. 
System 2 higli school subjects performed no belter than, and in several 
cases worse than, their System 1 counterparts, parallelling the results 
obtained in the role playing under authority surveillance. Thus it appears 
that while System 2 individuals can behave creatively when free of the 
observation of an authority, a condition that rarely exists in the sch'^ 
system, their performance, at least on certain kinds of tasks, decreases 
when it is to become the knowledge of and possible basis of action by a 
representative of institutional authority. 

Neither the role playing study by Harvey nor the investigation by 
Brown 'add Harvey touched upon the important question of how the 
differential performance under the different social conditions is medi- 
ated. Is it, we asked later, that the individual, especially the System 2 
representative cannot or will nut perform as well cn the particular tasks 
when that performance is to be known to an authority figure. That is, is 
the decrement more attributable to such a factor as super-optimal 
a.'-ou.sal and depressing of central processes by autonomic activity or to a 
gene'iUi negativism and refusal to try? Moreover, we subfiequently won- 
dered, is it thj status or power (i.e., the formal position or the fate 
control of the "autho^'ty" that seemingly affects adversely, tJ.e per- 
formance of the System 2 individual? A study currently underway in 
which the performance of high school representatives oT the four belief 
systems on several complex tasks under tiiree levels of induced arousal 
should help resolve these kinds of questions. 

Confirmation of the general hypothesis that differeiu/ performance 
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of concrete and absuact subjects is mediated I arousal and autoiiOmic 
activity would have clear implications for educators. It would say, for 
example, that in order for the more concrete ..';'dents lo learn in ways 
we espouse, that is inductively and insightR-K' vhra they particularly 
must be surrounded by conditions that mii nu/<' ;.he activity of the 
autonomic system. This, in turn opens un a bi d but significant area of 
research: to detcnine the classroom and pedagogical methods that ac- 
complish this. Ot liiese, clearly attributes of the teacher and the environ- 
ment he or she creates in the classroom are crucial. The methods of 
System 1 teachers, whici; involve high surveillance, high dictatorialness, 
higii costs to students for failure and the apparent conception of stu- 
dents as chattel or pawns, to borrow a term from Dick de Charms 
(1969), are bound to result in failure for most students, particularly the 
more concrete ones. This is not to say that the methods of the System 
1 instructor may not effectively inculcate certain responses catechismi- 
cally and as conditioned responses but they cannot produce learning 
wiih insight and the ability to be open, independent, flexible and crea- 
tive individuals. 

In an address a couple of years ago entitled ^'Feudalism Revif'.ved: A 
Sojourn into Graduate Education," (Harvev, 1967) I attempted to 
examine certain parallels between practices in the Germun concentration 
camps and tl.'e typical educational nrocess. I intended to be neither 
cynical or amusing but rather to fir ■ depict the factors I had isolated as 
causing idertification of the Jewish prisoners with the Nazi guards and 
then to examine *hn possible extent to which those same variables were 
operating in tl'ie school s/stems, from kindergarten tlffou^h graduate 
school. After many years of thinking about the problem, I concluded 
that by the nvzr.ipulation of three factors individuals can be made slaves 
and human robots. These are: (1) external fate control, i.e., the. condi- 
tion in which one's fate (his rewards, punishments- , etc.) are determined 
by an out-iJe agent over whom he has no direct influence; (2) high 
involvement, which in the concentration camps centered around life it- 
self and which in education, especially at the graduate level, centers 
around self worth and esteem; and (3) capriciousness or intermittent 
reinforcement, which generates conditions in which the recipi,iit can 
never ascertain what he is to do to gain consistency and the feeling of 
some d.:;gree of control over his own fate. 

It is apparent, I believe, that external fate control, high involvement 
of students (i.e., threat) and capriciousness of teachers and fate con- 
trollers cl-aracterize raost of our current socialization processes, includ- 
ing educaiion. Many persons today in education seem to be perpetuating 
and even .;^rengthening"thef,e tendencies under the assumption they are 
helping to obliterate thein. Among such persons I would include nut 
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only Sysiem 1 teachers in the classroom but many university-based "ex- 
perts" who are espousing certain varieties of operant conditioning and of 
;he so-called discovery and inquiry methods. This is not meant to be an 
indictment of these latter approaches in general but rather of those 
practitioners who operate from a kind of unwitting omniscience and 
omnipotence that results in their defining the elements to be discovered 
or what the reinforcers shall be without influence from the students, in 
their imposing the rules or routes for inquiring and/or prescribing on 
their own the contingencies of reii^forcement, and in their deciding ac- 
cording to their criteria when the performance is satisfactory and should 
be rewarded. I recently asked a well known person in the 'inquiry" 
method if the teacher prescribed the elements of the problem, the rules 
for exploration and the conclusions that were warranted should we be 
surprised that the student reaches the same conclusion as the teacher. 
The only thing the student can discover under those conditions, it 
would seem to me, is what the teacher has in her mind, not new ap- 
proaches and solutions to the problem. 

Students have come to understand and become concerned about the 
general convditions of current education. Much of their present agitation 
and assault upon the establishment center around the same issues that 
have sparked jnany revolutions. To continue the reinforcement language, 
these issues largely boil down to a desire to help define and prescribe 
the nature of the reinforcers, the conditions of their administration and 
who shall administer them. in, it should not be surprising that peo- 
ple, including students, should \/ant to have a hand in these instead of 
relinquishing this incredible power to an omnipotent and omniscient 
•external agent, 

Application of Attitude Change Methods to the 
Fostering of Abstractness 

For young children whose belief systems have not yet crystallized 
and stabilized abstractness may be fostered by the provision, in the 
home and the school, of the kinds of environments described in System 
4 f ichers. Progression ioward System 4 functioning can, at least theo- 
re'-cdly, be facilitated in the young child by the environment that 
encourages him to explore both his physical world and his world of 
values, to discover new elements and to put them together in his own 
way without fear of punishment and/or rejection. Note that these condi- 
tions, which might be termed a process orientation^ could be made to 
surround the imparting of any educational content or subject matter, 
from poetry through physics, and theiefore that any one of these topics 
could be used as a vehicle for inducing abstractness as well as anoth=jr. 
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However, since sludenls seemingly develop their belief systems quite 
early, from home and e'lrly school experiences the question of iiow to 
change them rather than to influence their original formation becomes 
important. This section of this paper will attempt to make application 
of findings in attitude change research to this general question. The 
application will center around the basic issue of what kind of "source" 
(and presumably teacher) is effective for enhancing change in respon- 
dents (hopefully, including students) of different belief systems. An 
effort will then be made to apply some of these notions of attitude 
change to the effective use of educational media. 

Ch^r-ctertstics off.': EffecU' e Source 

^v^s'i^xn 1. The apparent nature of this system would imply that in 
order for a source or Teacher to be a "significant other" in the eyes of 
its representatives and to be able to influence them in direction 
counter to their'own beliefs he should be of higli formal status, behave 
in accordance with clear-cut definitions and issue highly structured and 
rule oriented messages. 

In line with this hypothesis, Crockett (1958) found i.:ore authoritar- 
ian soldiers to prefer more autocratic leaders. And in an unreported 
study, Harvey found that college students representing System 1, to a 
greater extent than representatives of the other systems, preferred in- 
structors who were higli in academic ranl^"., gave precise and higlily struc- 
tured assignments, made the criteria for grading very explicit, and gave 
lectures of greater absolutism and simplicity, i.e., of fewer contingencies, 
more "facts" and fewer theoretical interrelationships. 

In further accord with this reasoning are the findings from several 
experiments that concreteness (as measured by scales of authoritarian- 
ism) tends to be positively correlated with attitude change (e.g., Crutch- 
field, 1955, Wagman, 1955; Christie & Cook, 1956* Titus and Hoiiander, 
1957; Harvey, 1963c; Harvey & Beverly, 1961; Wriglit & Harvey, 1965). 
Significantly, the relationship between authoritarianism and attitude 
change holds only for a high status source. As we have suggested, 
"Authoritarianism is positively related to opinion change when the 
source of the incongruous input is of high status and the target concept 
is of low involvement. But it is negatively related to change when the 
source is of low status, and th^- target concept is of high involvement.'" 
(Wright & Harvey, p. 180). 

That concreteness sensitizes an mdividual toward status and power 
may be inferred from a number of studies (e.g., Harvey, l963a; 1964, 
1966; Harvey & Beverly, 1961; Kritzberg, 1965; Tiemann, 1965). At 
least four studies have dealt specifically with source characteristics and 
influence on representatives of different belief systems. 
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The first of these sfidies was car-ried out by. Harvey and Beverly 
(1961). Following rermation of ih.eir preasscssed attitudes toward alco- 
hol by a high status and powerful source, subjects varying in concrete- 
ness were asked to reproduce the main arguments of the speaker (who 
was both their instructor and m/.nister of their churc!') had made in 
favor of alcohol. Despite changing their opinion more in the direction of 
the communication, the more concrete and authoritarian subjects were 
able to reproduce fewer of the speaker's points than were the persons 
lower in authoritarianism. Thus the more concrete individuals appear to 
have changed their^opinions more because of the status of the source 
than from dieir grasp of the reasons he advanced for a change. 

In a second study fHarvcy, 1964) colle^^e student representatives of 
the four systems among other tasks, judged the contents of 16 projected 
slides of varying clarity following 'exposure to a pre-recorded narration 
that described the contents of each slide in a general way. The contents 
of the nine more ambiguous slides were incorrectly depicted while the 
contents of the seven slides of greater clarity were correctly described. 
The narration accompanying projection of the slides was attributed to 
either an undergraduate student interested in photography (low status 
source) or to a professor of psychology interested in the slides as experi- 
mental stimuli (higli status source). As h^qDOthesized, the number of 
incorrect descriptions accepted in identification of the slides under the 
higli status condition was greater for System 1 tTian any other system. 

A thiid., and unreported study on this topic was carried out by Ware 
and Harvey (1968). College -student representatives of each of the fou; 
belief systems first formed, alor-e, judgmental norms of^the distance 
between pairs of liglits in a dark room. They were then exposed to' 
judgments of a source (a trahied collaborator) that deviated from their 
individual norms by a prescribed amount. The source of the deviant 
judgments was a person who in the eyes of the subject represent one of 
four combinations of expertise and status; higli expertise-high status, 
higli expertise-low status, high status-low expertise and low status-low 
expertise. Following the influence situation, subjects again made judg- 
meats of liglit distance alone with r-^ mention of rewards- They then 
made additional judgments under the instruction that the most accurate 
person would receive a cash award. This procedure thus allowed us to 
determine the influence on individuals of different belief systems of 
different kinds of sources under surveillance and non-surveillance and 
under a no-cost and potential reward condition. Main effects, first- 
second and third order interactions were obtained. Of greater relevance 
here is the finding that , representatives of the different belief systems 
relied upon different source characteristics in both changing their judg- 
ments and maintaining the changes. As anticipated. System 1 individuals 
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relied on the status of the source and not on liis expertise. Thus they 
changed their judgments equally highly when the source was of high 
status and low expertise as when he was of higli status and high exper- 
tise. On the other hand, System 2 individuals were most influenced by 
the low status-higli expertise source; System 3 individuals by the high 
status-high expertise source; and System 4 individuals, to the extent 
they were influenced at all, by the dimension of expertise, being equally 
inHuenced by low status-high expertise as high status-high expertise. 

The fourth and most recent study of this question is the doctoral 
dissertation of Bernardo Garso at the University of Utah (1969). Sub- 
jects, who were representatives of Systems 1 and 2 at the Utah State 
Training School for Boys, were exposed simultaneously to "messages" 
from a high status and a low status source. In one part of the study 
subjects listened dichotically to numbers they had been instructed to 
listen to by a higli and low status source; in the second part of the 
study they were read two stories at the same time from the different 
status sources. In both instances. System 1 boys were more influenced 
by the higli status than by the low status source while the reverse was 
true for the System 2 individuals. 

Not only is overt-behavior change, which ultimately may be no more 
than acquiesence, facilitated in the concrete individual by a high status 
source, it is further enhanced by the source making strong and absolute 
assertions. Thus Harvey and Rutherford (1958) found that more con- 
crete individuals changed their concepts of light movement more from 
an absolute than a gradual approach, i.e., from an approach in which the 
source made all of his judgments differ a fixed r:mount from those of 
the subject instead of first making his judgments match those of the 
subject and then gradually deviate from them. 

That a higli authority source making strong and absolute assertions 
will modify the overt response of the more concrete subjects, at least as 
long as the authority is present, seems clear. But it appears, according to 
the Harvey and Beverly study (1961), that this behavior change is not 
accompanied by understanding. If, as we educators proclaim, education 
is aimed at producing change with understanding, then other steps have 
to be taken to increase the abstractness of System 1 individuals. It is 
likely that higli status sources making absolute statements, while fitting 
in with what System 1 individuals seek and are familiar with, will only 
tend to strengthen their concreteness, although at the same time such a 
combination of source and absolutism may result in their catechismic 
acceptance of what is being advocated. 

To gain acceptance from a System 1 individual at the same time he is 
being rendered conceptually more open and abstract would seem to 
demand a strategy that at the outset of the change attempt provides a 
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great deal of structure and guidance from higli status sources but which 
with time and experience move away from external structure toward 
requiring the individual to make more and more decisions on his own. 
Tliis would represent a kind of weaning from the need for guidelines 
imposed by an outside autliority toward tlie individual assuming inde- 
pendently the responsibility for his own criteria of behavior. From 
earlier indications, it would appear likely that a System 4 teacher could 
best provide the environment and conditions necessary to achieve this. A 
concrete teacher, because of the paucity of jier response repertoire and 
inability to act as if, would have greater difficulty in "wearing the 
several Iiats" that would be required in providing tlie optimal amount of 
structure and guidance to the developing or changing student. 

Systems 2, 5, and 4. Because of the paucity of data specifically 
relevant to the question of what kind of source characteristics are most 
effective for each of these systems, they will be considered together. 

The earlier depiction of System 2 would indicate a negative orienta- 
tion toward authority sources by its representatives and presumably a 
negative weighting by them of cues emanating from authority. The re- 
sults of the studies by Ware and Harvey (1968) and Garso (1969), which 
have already been mentioned, confirm this assumption. Also in line with 
this assumption is the finding of Harvey (1964) that System 2 indi- 
viduals were significantly more influenced by a low status than by a 
higli status source in the number of incorrect descriptions of the slides 
they accepted, just the opposite of System 1. 

The study that found representanves of Systems 1 and 2 to be 
■strongly influenced by the status of the source in their acceptance of 
falsely depicted slides (Harvey, 1964) also found individuals from Sys- 
tems 3 and 4 to be only slightly influenced. "The acceptance of false 
descriptions by System 3 individuals, high under the low authority con- 
dition, was only sliglitly increased under the high authority variation; 
and System 4 representatives, who accepted a relatively low number of 
false depictions under the low authority condition, accepted only a frac- 
tion more under the- high authority treatment" (Harvey, 1964, p. 220). 

Another part of the same study suggests tliat System 3 individuals are 
more susceptible to peer group than to authority influences. Representa- 
tives of each of the four systems, in addition to being asked to identify 
the contents of the 16 slides, judged the distance between 12 pairs of 
dots, first in the presence of a falsely calibrated but authentic appearing 
ruler, and then in the absence of the ruler but with knowledge of the 
judgments of other members of a temporary triad. Judgments in the 
social context were made under instructions that either made no refer- 
ence to conformity or specifically depicted the experiment as one in 
conformity. As predicted, the degree of social influence, as measured by 
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the difference between an individual's judgment before and after group 
discussion, was greatest for System 3 in the condition that made no 
reference to conformity. While specific reference to the experiment as a 
study in conformity reduced the social influence only slightly on Systems 
1, 3 and 4, it lessened it markedly on representatives of System 2, 
implying a greater tendency toward negative independence on the part of 
these last individuals. 

Two studies have already been referred to that suggest that while 
representatives of System 2 may be quite creative when removed from 
surveillance and probably evaluation by a distrusted authority (Harvey, 
1963; Brown & Harvey, 1968) they are likely to be impaired in their 
performance, through either super-optimal arousal and/or uncontrollable 
negativism, when their fate is in the hands of an authority they don't trust. 
Two further pieces of information will be related to this possibility. 

The first bit of information was gathered from a study by Adams, 
Harvey and Heslin (1966) that involved hypnotic induction of different 
childhood pasts in representatives of each of the four belief systems. 
Especially relevant to the present point was the finding that representa- 
tives of System 2 . were far more resistant to hypnosis than representa- 
tives of any other system, presumably because uf their fear of authority 
and reluctance to disclose things about themselves that might possibly 
be used against them by the distrustful hypnotist. 

The second bit of information was derived from a study of delin- 
quency by Juers and Harvey (1963). Through use of records, 100 boys 
who had been committed to a Minnesota State Training School were 
classified into the four belief systems. As would be expected, a pre- 
pojuderance of original commitments represented Systems 1 and 2 with a 
few from System 3 and none from System 4. The more striking result 
was that while Systems 1 and 2 were fairly equally represented in first 
commitments, approximately 85 per cent of second and subsequent 
commitments, were accounted for by System 2 boys. This led us to 
conjecture that the kind of external fate control, rule orientation and 
punitiveness that tends to characterize state training ^ichools for delin- 
quents might be somewhat effective for changing boys of System 1 but 
largely ineffective for inducing the sought affects ^on representatives of 
System 2. If this is correct, a message is available* here on some of the 
causes and potential cures for the high incide^ice of current drop-outs 
from our public schools and other educatioria! establishments. 

Some Implications for Educational Media 

Whatever relevance belief systems theory may have for educational 
media, if any, should depend upon the kind of medium, the kind of 
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material, the message to be communicated and the belief systems, as 
well as other personality attributes of the recipients. Because of this and 
my own vast ignorance of the various media, 1 shall offer only a few 
simple suggestions inferred from the apparent relationships between be- 
lief systems and attitude change noted earlier. 

To extrapolate from our theory and data, it would appear that for a 
"message" to be maximally effect-ve for a representative of System 1 it 
would need to spring from or apparently be endorsed by an individual 
of higli status, be presented in an authoritative and decisive way with a 
clear cut, single conclusion drawn, and, where possible, be made to 
relate to patriotism, morality and the good of yesterday. 

Presumably the effective message for a System 2 individual should be 
cryptic, clever, even cynical^ give the implication of being anti-establish- 
ment and issue from a source of low status and high expertise. 

A representative of System 3 would probably .be influenced positively 
by a communication that provided more than one side to an issue, came 
from a source of either high status-higli expertise or low status-low 
expertise, and suggested its relationship to togetherness, fellowship and 
aid to the underdog. 

The representative of System 4 could be positively influenced^ by a 
wider variety of communications than persons of any of the other sys- 
tems owing to his greater concern with what is being communicated 
than who is communicating. Perhaps he would be maximally influenced 
by the approach that was novel, provided several alternatives with a 
great deal of evidence for each and which, only offered suggestions for 
multiple conclusions instead of spelling out one decisively. 
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The designer of instructional systems which deal with affect has k- ' 
cess to many psychological theories and research evidence as to h<MW 
emotions are learned and expressed. Awareness and application of these 
theories and empirical findings can be helpful to the educator who is 
attempting to create and design educational material. These theoiries 
represent different emphases, and vary in the amount of influ.'nce they 
have exerted in the field of education. 

Affective Learning 

Learning and development theories are often concerned with the ac- 
quisition of affective behavior in children. For e:;ample, the theories of 
Freud, Gesell and Piaget are representative of the view that children pass 
through a sequence of stages of emotional development which i:5, in 
part, predetermined by the inherent nature of the organism. The usual 
implication is that all children pass through these stages in a relatively 
fixed sequence, and are unable to progress to the next highest level of 
affective learnings until they have integrated previous learnings. 

Another theory holds that some feeling states, particularly anger and 
aggression, are learned in response to frustration. Many experimental 
studies have been conducted to investigate the possible effects of frustra- 
tion on emotional and intellectual behavior. Proponents of this view 
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often attribute affective outcomes such as destructiveness and aggression 
to the presence of frustration within the child. 

Still another well known theory holds that behavior is learned be- 
cause that particular mode of behavior has been reinforced. It is fre- 
quently pointed out that such reinforcement for this behavior usually 
comes from another person. For example, in the case of the young 
child, affective behavior is th.ougiit to be learned througli reinforcement 
from parents. 

All of these well-published theories have implications for the designer 
of instructional systems. In addition, one emerging psychological theory 
which should have great impact in the field of education is known as 
social learning theory. Social learning theory is concerned with the learn- 
ing that occurs simply through observing other people. That is, if the 
observer subsequently behaves, in an affective fashion for example, simi- 
larly to the people he has observed, it can be hypothesized that he has 
learned affective behavior through imitation. It is important to note that 
this explanation does not require the concept of reinforcement as a 
necessary condition. Therefore, this theory often stands in marked con- 
trast to the operant conditioning analysis of behavior. 

To date, social learning theory has not had substantial influence on 
the design of instructional systems. It is particularly well-suited to forms 
of educational media. Application shows (1) it can result in the rapid 
acquisition of complex behaviors, particularly affective behaviors; (2) 
mediated presentations are as effective, and considerably more efficient 
than live demonstrations; and (3) many learnings can be taught to rela- 
tively passive learners, a situation similar to the typical classroom situa- 
tion. Although considerable experimental research has been directed to 
identifyi: g the optimal conditions under which behavior is acquired 
through the observation of another person, it remains for the instruc- 
tional technologist to translate these results into the design of an educa- 
tional system. This translation, however, is a relatively simple task, once 
the basic tenets of the theory are understood. 

Social Learning Theory 

Basically, social learning theory attempts to account for the learnings, 
both cognitive and affective, which occur through observing others. The 
exact mechanisms by which these behaviors are learned are yet to be 
subjected to experimental verification.- The fact that such learning does 
take place, however, has been well established experimentally. Because 
the exact mechanisms are still somewhat obscure, the social learning 
theorists often use the technical phrase '^modeling" rather than "imita- 
tion," for imitation connotes conscious intent.* 

*The terms will be used Interchangeably in this paper. 
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Already, there are considerable results from existing research in this 
field which will aid the educator in designing situations from which 
learners can acquire certain 'types of behavior. Future research promises 
to investigate the exact processes in the relationship between the stimu- 
lus situation and observed responses, so that ultimately we will be able 
to effect even greater control of the designed stimulus situation. Never- 
theless, existing findings are quite adequate to exert a substantial influ- 
ence on the design of instructional systems if appropriately applied. 

Experimental Investigations 

The purpose of this section is lo investigate representative research 
and to suggest ways of applying the results. 

Many kinds of affective and cognitive learnings can be investigated 
through Social Learning Theory. One emotional pattern that has been 
extensively studied by Social Learning Theorists, as well as other theo- 
rists, is the learnings associated with the expression of aggression. In 
initial experimental investigations, one prerequisite was that the emotion 
to be studied had to. be easily observable, and the outward overt ex- 
pression of the feeling of aggression was selected because it - could be 
very easily observed. For this reason, a series of experimental studies 
were centered around the concept that a normal unfrustrated child has 
the potential for and probably will be aggressive after simply watching 
another person act aggressively. Direct rewards were not felt to be es- 
sential for insuring imitative or matching aggressive responses. 

Some of the earliest experiments were conducted by Bandura who 
worked with nursery school children. (Bandura, et al., 1961, 1963). A 
typical study involved having one group of children watch models en- 
gage in aggressive acts, while other children, randomly assigned to an- 
other group, observer^ nonaggressive models. All children were then 
taken individually to a room similar to where the models had per- 
formed. The children could then be observed to determine whether they 
would spontaneously imitate the model's behavior or whether they 
would do something different. It was repeatedly found that children 
who had been exposed to an aggressive model subsequently produced a 
significantly larger number of aggressive responses. The exact form of 
aggression was often very similar to that which they had seen demon- 
strated by the model. For example, if the model had hit the Bo-bo doll 
with a mallet, the children who had observed this were often seen to hit 
the Bo-bo doll with a mallet. 

General, conclusions from this type of experiment suggested that chil- 
dren can learn aggressive (one category of affective) responses, by ob- 
serving other people who demonstrate these responses in their behavior. 
Q A series of experiments were conducted to investigate various 
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situational conditions whicli may result in overtly aggressive Vchavior. 
These experiments attempted to answer such questions as, what is the 
effect of observing a model who is filmed rather than being present in 
the same room? What effects do the condition'^ of reward and punish- 
ment have on the learning of affective bebrvior? Some of the resultant 
literature suggests that the method which the presentation of the 
stimulating situation is mediated relatively unimportant. Imitative ag- 
gressive behavior in children has been noted, not only in situations in 
which the child has obccrved a live person being aggressive, but also 
when observing a f'lined person being aggressive, or even a cartoon char- 
acter being ag^r^^sive. (Bandura, et al., 1963a). 

When model being observed by the child was punished for acting 
aggre* .vely, only a few children spontaneously acted aggressively when 
subsequently given the opportunity. (Bandura, 1965; Walters and Park, 
1964)> The question could then be raised as to whether the rest of these 
cliildren had really "learned" the aggressive behavior since they did not 
display it. By contrast, it was consistently observed that if the model 
was rewarded for being aggressive, many children would spontaneously 
imitate that aggressiveness, and furthermore, would behave aggressively 
for a long period of time.' Thus, punishment appeared to decrease learn- 
ing, and reward appeared to increase learning. To test this, an experiment 
was conducted in which the experimenter promised to reward children 
who had observed the punished model if they would imitate what the 
punished model had done. Those who had originally seen the model 
punished but had failed to imitate him, then showed as many imitative 
aggressive behaviors as the group who had watched the rewarded model. 
This suggested that the children had "learned" the punished aggressive 
responses and had stored them. Althougli they had not originally ex- 
hibited them, these learnings were available to the child when the situa- 
tions for imitating them were more opportune. (Bandura, 1965). 

Limited experimentation has also been done with modeling of other 
emotions. For example, there is some indication that preschool children 
are more likely to imitate a helpful affectionate model, than an aloof, 
impersonal one. (Bandura, 1961). 

Although studies involving the production of overt aggression in chil- 
dren have been more widely publicized because of their dramatic im- 
port, the production of other types of affective and cognitive behavior 
have also been effectively produced by experiments resulting from Social 
Learning Theorists. For example, decision making processes iiwolved in 
the making of moral judgments often contain components of both af- 
fective and cognitive behavior. 

One experiment was designed to explore whether moral judgments in 
children could be influenced rind altered by presenting models who gave 
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a moral judgment opposite from that of the child's. Children were 
divided into two groups. The division depended on responses to stories 
designed to assess their moral orientation. Children placed in one group 
had tended to make judgments in terms of "objective lesponsibility," 
that is, they usually judged conduct in terms of the amount of material 
damage resulting from it. Children in the other group had usually judged 
acts by the degree of "subjective responsibility," that is, in terms of the 
intentions of the actor rather than by material consequences. These two 
groups of children were then exposed to behavior of a model who 
exhibited the oppowYe judgmental framework from the child's. 

Three 'conditions were structured for each group: In one condition, 
the children observed models who expressed moral judgments which 
were counter to that the child had expressed, but no reinforcement was 
received for matching the model's behavior. In the second condition, the 
children observed models who expressed moral judgments which were 
counter to theirs, and in addition, the children were then positively 
reinforced for any adoption of the model's opposite type of response. In 
the third condition, there was no exposure to any models, but the child 
was reinforced whenever he expressed any moral judgment opposit3 to 
that that was dominant for him. 

Operant conditioning, by itself, was found to produce only a slight 
increase in change of moral judgments. But, provision of models alone, 
or .of models plus reinforcement, were equally effective in significantly 
shifting the children's judgmental decisions to the opposite type. (Can- 
dura and McDonald, 1963). Judgmental decision making as described 
above, involved not only affective, but also cognitive components. Thus, 
Social Learning theory can be seen to be applicable to a variety of types 
of behaviors. 

As a result of these kinds of experiments with children, ^nitial at- 
tempts have been made to translate* the theory into instructional systems 
for young adults. For instance, one continuing problem of education is 
the exposure of student interns to a variety of desirable teaching tech- 
niques in- such a manner that the interns will be able to effectively 
emulate such techniques. In a typical experiment designed to study this 
problem, a teacher intern would observe a videotape model performing a 
specific teaching behavior, for example, asking higlier order questions (a 
question which involved some integration of knowledge on the part of 
the pupil rather than a simple "yes" or "no" response.) After exposure 
to the model, the trainee was instructed to teach a lesson attempting the 
same class of behaviors which he had observed. This presented the intern 
with a far more difficult task than the simple imitation exhibited by 
small children, because the behavior he had observed could not be lit- 
erally imitated. The teacher intern never taught exactly the same lesson 
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as the model. He had to observe, interpret, and apply the model of 
behavior to a similar, new situation. After observing the videotaped 
model, the teacher intern then selected a topic for his own lesson, 
organized it in the way he preferred, and taught the lesson in his own 
style. Thus, if he had observed a model asking a specific level of ques- 
tions, such as evaluative questions, he then had to construct similar 
questions on an entirely different topic, and ask them of different stu- 
dents who might respond, but not. in exactly the same way tliat the 
students in the demonstration had responded. Under these conditions, 
requiring transfer, modeling effects are often observed to occur. Signi- 
ficant learning of the desired teaching behavior was exhibited, although 
on a. lesser degree than when responses could be literally imitated. 
(^McDonald and Allen, 1967)> 

One significant piece of information for future designers of similar 
instructional systems became very apparent during these studies. This 
was the importance of clearly signaling to tlie learner exactly what the 
desired behavior Vv^as which was to be imitated. If we think of the 
observer as an information processing system with definite limits on his 
ability to process multiple types of information, then the advantage 
clearly cuing the observer to the behaviors which are to be imitated can 
be seen. A subsequent experiment demonstrated that the addition of 
cuing or signaling cues during the time the teacher intern is observing 
the model will significantly influence the learning of the intern. (Claus, 
1968). 

Facilitating Conditions 

These studies and others similar to them indicate that many different 
kinds of behavior, simple and complex, affective and cognitive, can be 
learned by observation. Social learning theorists assume from this that a 
substantial proportion of behavior is learned by observing, and by ob- 
servation alone. However, several conditions have been found to enhance 
the acquisition of behavior that is learned by observing: 

1) Utilizing the motivational system of the learner. If the learn- 
er comes to the observation of a model with motivational pre- 
dispositions, the designer of an experiment or an educational 
system can then arrange the conditions to be observed so that 
they will arouse motivations already present in the learner. An 
example of this was a study of preschool children in which the 
aggressive model succeeded in capturing all the available toys in 
a playroom from another child. When the observing children 
were later questioned as to which person they would like to be 
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like, many slated they would like {o be like '*Rocky/' the 
aggressor. A typical answer was that "Rocky had got all the 
toys." In this case the authors had assumed that the children 
were motivated to acquire toys. Observation of the model 
demonstrated that one way to get the toys was by being ag- 
gressive. Thus the situation had been arranged to arouse the 
motivational system already present in the observers. (Bandura; 
et al., 1963c) 

2) Reinforcement. Although learning in the affective and cog- 
nitive realms can take place througli observation alone, and thus 
is independent of reinforcement, it has been found that either 
actual or inferred reward of the model will facilitate acquisition 
of imitative learning. In some of the experiments the learner 
had observed the model being rewarded; in others, the learner 
had been able to infer that the portrayed behavior will be re- 
warded. There is also some evidence to indicate that a learner 
can learn to administer rewards and punishments to himself in 
the same way that a model hus rewarded or punished himself 
for responses. (Bandura and Kipuras, 1964; Bandura and Wha- 
Ian, 1968). Reinforcement and reward are also helpful in main- 
taining the behavior. The general principle here is that modeling 
facilitates acquisition of behavior, and reinforcement facilitates 
retention of that behavior. 

3) Practice and Rehearsal. The social learning studies make it 
clear that practice or overt rehearsal is not a primary factor in 
the acquisition of behavior. Provided that the learner has the 
response capacity, responses will be acquired with no observable 
practice, although we generally assume that some covert rehear- 
sal iniiy be occuring. However, practice may exert a facilitating 
effect in some instances. An example of when overt rehearsal 
may be helpful or necessary in acquiring responses occurs when 
the learner must develop the capacities of two sensory systems 
so that they will operate in an integrated manner, as in the 
learning of a new and complex visual motor activity. But when 
the responses are already available, and are simply to be inte- 
grated into a new pattern, or when components of the re- 
sponses are already learned and available, overt rehearsal is usu- 
ally not required. 

Directions of Future Research 

There are two major conceptions of the process which may be inter- 
vening between the stimulus input situation and the observed ou/come 
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response. The first of these is known as contiguity theory, the second as 
mediational theory. Both of these theories attempt to construct a pos- 
sible '-Hnk" between the observable actions of the model (the stimuli) 
and the reproduced action of the observer, (the response). It is thought 
that this ''link" may be some type of non-observable representations of 
the model's action within the system of the learner. These could theo- 
retically be stored within the learners' information processing system 
and be re.;alled subsequently, thus acting as stimuli which direct the 
learners' resultant actions. Therefore, these representations could form 
the basis for the resultant imitations of the original act which the learn- 
er had observed. 

The contiguity explanation stresses the importance of temporal juxta- 
position of stimulus and response, holding that learning will occur 
whether reinforcement is given or not. Since we know that imitation or 
T.odeling effects do occur without the presence of reinforcements, con- 
tiguity theory supplies one possible rationale for this observed behavior. 

In the mediation explanation, the ''link" between the subject's ob- 
servation of the model and his own subsequent behavior is thought to 
be symbolized in the form of images or words. Either of these forms of 
symbolic representation are then thought to possess stimulus qualities. 
For example, there is some evidence which indicates that children who 
generate verbal descriptions of the modeling stimuli, will then produce 
significantly more matching or imitative responses than children who 
simply observe the modeling behavior without generating verbal descrip- 
tions. (Bandura, et al., 1965). While both of these theories attempt to 
account for the basic phenomena in modeling behavior by introducing 
the construct of intervening responses which "store" the model's be- 
.havior, and which subsequently act as stimuli which elicit imitations of 
the model's behavior, neither theory has been extensively tested to 
determine whether one or the other has greater explanatory value for 
accounting for modeling rffects. When such information does become 
available, greater control of the stimulus situation will then be available 
to the educational technologist. 

Applications to Educational- Design 

Present social learning theory has many potential applications to edu- 
cational technology and to instruction. The results of research on ob- 
servational learning may be applied in a similar fashion regardless of 
whether one accepts a contiguity theory explanation, or a mediational 
theory explanation to account for the effects of learning from observing. 

The research in social learning theory suggests that maximal learning 
will occur under the following conditions: 
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1) If the behavior to be modeled can be observed, 

2) If the cues to be imitated are clearly indicated to the observer or 
if the observer verbally expresses the cues which he perceives as 
important, 

3) When the acquisition of an observed behavior can be shown to 
have actual or potential reinforcing consequences for the learner, 

4) When reinforcement and/or feedback- is actUL.ly provided for ap- 
propriate imitation, 

5) When provision is made for a practice phase. 

How can these experimental findings be translated to the design of an 
educational system? Decisions involved in tlie application of theory to 
practice involve: 

1) Analysis of Desired Behavior. When the modeling paradigm is 
applied to instruction, a complete behavioral analysis of what is to be 
learned is essential. Though this suggestion will be readily accepted, the 
necessity for analysis prior to developing models cannot be stressed too 
strongly. The designer must describe the behavior to be learned in terms 
of observable responses, that is, he must plan to create an actual visual 
portrayal of the behavior. This description is different than the usual 
description of behavioral goals, it is the difference between describing 
how teacliers should reward tlieir students for participating in class dis- 
cussions, and actually showing a teacher enacting this bchuvior. There 
are two main ways in which this modeling demonstration can be ar- 
ranged: a) the model can simply portray a sequence of behavior; or b) 
the model can respond selectively to different stimuli. In the latter case, 
the behavior portrayed should te linked to specific cues by a reward 
and punishmijnt system. The learner then learns both the responses and 
the discrimination, 

2) Portraying behavior. The second step is involved with decisions as 
to how to portray the behavior to be learned, i.e., the stimulus input. 
The designer will base his decisions on such factors as: 

a) his perception of the need-motivational system of the learner, 

b) his analysis of the essential cues or signals to be shown to the 
observer, 

c) how and when to portray the reward consequences. 

Thus, the designer makes decisions about how to develop a model 
which makes the behavior to be learned easily observed, and also, how 
to portray the rewarding consequences of adopting the beliavior. Precise 
control should be maintained over the stimulus input in relation to the 
learner's information process capacities. As the behavior to be learned 
changes from relatively simple performances to more complex behaviors, 
control over the stimulus input becomes more and more critical. 

3) Provision for practice and reinforcement. Provision for practice 
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and reinforcement, although, not an absolutely necessary condition for 
acquisition of behavior, is crucial for optimizing acquisition of the be- 
havior and enhancing the retention of the behavior to be acquired. Rein- 
forcement can be overt or covert, that is, implied. It should be remem- 
bered that situations can also be structured so that the learner reinforces 
himself rather than being dependent on an outside agent for reinforce- 
ment. 

4) Instrumenting the system. Once the system is designed, the tech- 
nical problem of instrumenting the system occurs. The know-how for 
these problems is readily available. 

Instructional Paradigms 

Three main paradigms have been utilized in the research on social 
learning and should also be useful for design of instructional system. 
These relate to the behavior of the learner and are: 

1) OBSERVE MODEL REPRODUCE MODEL'S BEHAVIOR 

This paradigm may be expanded as follows; 

2) OBSERVE MODEL REPRODUCE MODEL'S RECEIVE 

BEHAVIOR REINFORCEMENT 

When paradigm (1) is used as the base for an instructional 
design, the rewarding consequences of imitating the model may 
be inferrable or demonstrated, but when paradigm (2) is used, 
actual rewards for imitating are given. 

3) With a slight modification, these paradigms may be combined into 
a feedback system which is an information-processing model of an in- 
structional system; 

PHASE 1 PHASE 2 

Stimulus Input Response 
OBSERVER MODEL REPRODUCE MODEL'S BEHAVIOR 

PHASE 3 
Feedback 
RECEIVE REINFORCEMENT 

Rewards for imitating 
Information on deviation 
from model's behavior 

The system becomes a cybernetic one by cycling the learner through 

it: Observe - rehearse - receive feedback • observe - rehearse The 

learner is taken out of the system when his behavioral reproductions 
reach a pre-established criterion performance. 
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This more complex system gives the instructional designer greater 
control over the behavior modification process. Providing for rehearsal 
gives the designer test points for checking the acquisition of the desired 
behavior change. These checkpoints are not only necessary to evaluate 
the learning but also to provide the learner with practice which is par- 
ticularly useful when complex behavior is being learned. The feedback 
component also guarantees that imitating the model has reinforcing 
consequences, and also may provide additional information to the learn- 
er. 

Research on this latter training paradigm shows that cueing the 
learners on the behavior to be learned during the modeling phase re- 
duces the need for cueing during the feedback phase (Claus, 1968). 
Discriminative training during the feedback session in addition to pro- 
viding rewards, is more effective than only providing rewards for imi- 
tating. (McDonald & Allen, 1967). The paradigm may be varied in many 
different ways as research on its components and combinations suggest 
ways to optimize instructional systems designed from it. 

Potential Areas for Application 

Social Leaniing Theory is particularly applicable to situations where 
the designer wishes to keep traditional lecture presentations to a mini- 
mum. The model does not need to tell the students the procedures for 
coping with a situation, rather he demonstrates successful coping tactics. 
This makes the technique particularly applicable to areas dealing with 
affect, such as the complex behaviors involved in inter-personal inter- 
actions. 

Typical examples of potential areas for application might be the 
affective and cognitive interactions involved in training teachers, in 
teaching creative problem solving behavior, and in teaching students to 
successfully interact with peers, adults, and administrators. 

In addition, modeling effective decision making in both cognitive and 
affective ac;«as should be easily possible both in relation to decisions 
about problems experienced with others, as well as decisions in relation 
to self-awareness and self-enhancement. 

Standardized presentations are possible under the application of this 
theoretical system because it is admirably suited to mediated presenta- 
tions to learners. The advantage of an instructional system which can 
utilize mediated learning presentations is the experimental potential 
which they present. The exact repUcability thus possible yields attendant 
opportunities for objective analysis, and revision, as well as utility with 
multiple types of selected subjects. In addition, successful coping be- 
haviors can be modeled to large numbers of relatively passive observers 
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(a typical classroom situation) with ihe reasonably confiGent expectancy 
that this behavior can subsequently be replicated by observers. 

Summary 

Social learning theory, as a formal psychological' theory, accounts for 
the learning that occurs by observing. This theory holds that affective 
and cognitive .behaviors are sets of responses /'which can be acquired 
through observation. The experimental literature is rich with studies that 
demonstrate this. At the present time, there has been only minimal 
application of this theory to instructional/techniques. Knowledge for 
instrumentation of instructional systems is readily available. Social learn- 
ing provides paradigm? useful in solving problems of the basic design of 
the system itself. All that remains is morr; extensive applications of these 
paradigms to a broad range of instructional problems. 

Referepces 

Bandura, A., Ross» Dorothea, and Ross, Sheila A. (1961). Transmission of aggres- 
sion til rough imitation of aggressive models. J. abnorm. soc. Psychol. 63, 
575-582. 

Bandura, A., Ross, Dorothea, and Ross, Sheila A. (1963a). Imitation of film-medi- 
ated aggressive models. J, abnorm, soc. Psychol. 66, 3-11. 

Bandura, A., Ross, Dorothea, and Ross, Sheila A. (1963b). A comparative test of 
the status envy, social power, and secondary reinforcement theories of iden- 
tificatory learning. J. abnorm. soc. Psychol. 67, 527-534. 

Bandura, A.» Ross» Dorothea, and Ross, Sheila A. (1963c). Vicarious reinforcement 
and imitative learning. J. abnorm. soc. Psychol. 67, 601-607. 

Bandura, A., and McDonald, F.J. (1963). The influence of social reinforcement 
and tlie behavior of models in shaping children's moral judgments. 7. abnorm. 
soc. Psychol. 67, 272-281. 

Bandura, A., and Kupers» Carol J. (1964). Transmission of patterns of self rein- 
forcement through modeling. J. abnorm. soc. Psychol. 69, 1-9. 

Bandura, A., (1965). Influence of models' reinforcement contingencies on the 
acquisition of imitative responses. J. Pers. soc. Psychol. 1, 589-59.5. 

Bandura, A., (1965). Vicarious processes: a case of no-trial learning. Advanced 
Experimental Social Psychology, vol. 2. New York: Academic Press. 

Bandura, A., and Whalen, Carol K. (1966). The influence of antecedent reinforce- 
ment and divergent modeling cues on patterns of self-reward. J. Pers. soc. 
Psychol. 3, 373-382. . 

Bandura, A., Grusec, Joan E., and Manlove, Frances L. (1965). Vicarious extinc- 
tion of avoidance responses. Unpublished manuscript, Stanford University. 

Qaus, K., The effect of cuing during modeling on learning a teaching skill. Paper 
presented at American Psychological Association Meeting, San Francisco, 
California, 1968. Copies available from the Stanford Center for Research and 
Development in Teaching, Palo Alto, California. 



Social Learning Theory 105 



McDonald, F.J. and Allen, D. \V.: Training effects of modeling and feedback vari- 
ables on teaching performance. OE-6-1 0-078. Stanford, California: Stanford 
University, Schotv( of Education, 1967. Copies available from the Stanford 
Center for Research and Development in Teaching, Palo Alto, California, 

Walters, R. H. and Parke, R. D. (1964) Influence of response consequences to a 
social model on resistance to deviation. J. exp. Child Psychol 1, 269-280. 



Attitude Measurement 



Allen L. Edwards 
University of Washington 

Bene C. Porter 
Teaching Research 



It is the purpose of this paper to introduce educational media tech- 
nologists to the field of attitude measurement-why it is important, 
some of the difficulties in measuring attitudes, some methods of gather- 
ing data, particularly through the use of attitude scales, and some of the 
common concepts in the area. 

The measurement of attitudes within the educational setting is be- 
coming an increasingly important component of evaluating both new 
and on-going instructional programs. As our knowledge about the inter- 
action between attitudes and other psychological processes such as per- 
ceiving, remembering, learning, and reasoning increases, it becomes ap- 
parent that we need to. assess the affective behavior of students as well 
as their cognitive behavior. 

A student's attitude toward a given course or subject area can be a 
contributing factor toward his achievement in it. Bui we are not con- 
cerned with academic achievement alone, even though a student does 
not show superior accomplishment in a given area, the development of a 
more favorable attitude toward the subject matter is a desirable end in 
itself. There are many instances in which instructors attempt to influ- 
ence the attitudes of their students toward a subject matter area, but 
rarely is an attempt made to measure the effects of these efforts. One 
such instance is Ir the teaching of science, where a teacher" hopes to 
promote favorable attitudes toward tlie scientific method of solving 
problems. This objective is not necessarily related to the achievement of 
the students. Even a student with a relatively low degree of achievement 
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may have developed a strongly favorable attitude toward the scientific 
method. 

In the humanities there is present at least the implicit objective of 
developing favorable attitudes toward literature, the arts and music. 
Achievement tests do not necessarily reflect the degree to which a good 
teacher has been instrumental in developing ihese attitudes. But if areas 
of affective learning as distinguished from the acquisition of 'specific 
content are recognized as importaiit, there should be some effort made 
to measure them along with achievement. 

The educational technologist is often called upon to furnish materials 
that will enhance interest and provide learning experiences that cannot 
be offered through regular classroom activities. In so doing, he is di- 
rectly involved with the promotion of favorable attitudes toward the 
subject area. He may find it of value to assess the effectiveness of his 
materials on the attitudes of the students, whether toward the materials 
themselves, or toward the subject area in which they were used. Mea- 
sures of students' altitudes toward a program as conventionally taught 
and as supplemented through the use of educational media may also be 
helpful in assessing the relative value of the two methods. 

Media presentations in themselves represent an important means of 
influencing attitude learning, or implementing attitude change in the 
larger social context. That media presentations may be used effectively 
to influence a change in children's attitudes has been shown in a number 
of research studies. Thurstone (1933) investigated the effects of a num- 
ber of motion pictures on the attitudes of children. The children's atti- 
tudes were first measured, then they were shown a film chosen to in- 
fluence their attitudes toward nationality, race, war, crime or the pun- 
ishment of criminals. Attitudes were again measured, either the day after 
the film was shown, or several weeks or months following exposure. The 
results consistently showed that the films had a significant effect on the 
children's attitudes toward social issues. There was also some evidence 
that repeated exposure to a single film led to greater attitude change, 
and that younger children were more influenced than older children. 

When a media technologist is involved in the selection or design of a 
program with the goal of changing attitudes toward some topic, issue or 
concept, it is necessary for him to be familiar with techniques of atti- 
tude measurement in order to provide an empirical assessment of the 
effects of his materials. Before discussing specific measurement tech- 
niques, however, it is of value to consider what it is that we are trying 
to measure and some of the difficulties inherent in the process. 

The concept of attitude has existed in psychological circles for a long 
time; in 1935 it was possible for Gordon Allport to state that ''the 
concept of attitude is probably the most distinctive and indispensable 
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concept in contemporary American social psychology. No other appears 
more frequently in experimental and theoretical literature." Except for a 
brief decline in the 1950's, Allport's statement could have been made 
with equal veracity in any of the ensuing years. 

The vast literature concerning attitudes reports on a wide range of 
topics, from experimental studies comparing the attitudes of two or 
more groups, or investigating the variables affecting attitude change, to 
the consideration of theoretical issues such as the nature of attitudes, 
their relationship to other cognitive processes and personality traits, and 
their distinction from related concepts such as beliefs and opinions. 

It is not our purpose here to delve into the conceptual elaborations 
of theoreticians over the past forty years. Although a great deal of 
discussion has taken place over the definition of attitudes, Thurstone's 
(1946) early definition of attitude as ''the degree of positive or negative 
affect associated with some psychological object." "Psychological ob- 
ject" is simply a generic term for any concept, issue, institution, ideal, 
person or group toward which individuals may have positive or negative 
feelings. A particular occupation, university president, political ideology, 
racial group, or labor union are all psychological objects. So also are 
concepts such as freedom of speech, and issues such as the war in Viet 
Nam, integration, and inflation. 

The basic dimensions of attitudes which we attempt to measure are 
included in Thurstone's definition. These are the direction-either posi- 
tive or negative, favorable or unfavorable-of an individual's feelings 
toward a psychological object, and the magnitude of that feeling. It is 
often not enough to know only whether a person is positively or nega- 
tively inclined toward something; we need to have more precise informa- 
tion as to the extent of his feelings. 

An analogous situation exists in other areas of measurement. It 
would, for instance, be possible to classify individuals in ternis of wheth- 
er they are above average, below average, or average in height. It would 
be much more useful, however, to specify an individual's height more 
accurately. Among these individuals who are above average in heights, 
there are obviously individual differences that are of some significance, 
particularly to a basketball coach. To know that an individual is above 
average in intelligence is useful information, but much more useful in- 
formation is provided if we know the degree to which an individual is 
above average in intelligence. A person with an IQ of 110 and one with 
an IQ of 170 are both above average in intelligence, but the latter is 
considerably above average whereas the former is not. 

Insofar as a person's attitudes predispose him to action in certain 
situations, we might expect that stronger attitudes would provide more 
motivation to act than would only slightly favorable or unfavorable 
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attitudes. Even thougli attitudes alone do not determine whether an- 
individual will act, they are a contributing factor, and as such can be 
used as one index in attempting to predict behavior. 

When our interest is in changing attitudes, a more precise determina- 
tion of both initial and post-treatment attitudes yields more accurate 
data as to the effects of an instructional program. 

The measurement of attitudes may be contrasted with the measure- 
ment of directly observable variables. It is not difficiilt to measure indi- 
vidual differences in a variable such as reaction time. A stimulus is 
presented and tlie time required for an individual to make a given re- 
sponse is measured accurately. The time' of reaction is directly observ- 
able,, and the measurement task consists of recording the observations. 
However, if an individual refers to a police officer as a "pig," what is 
observed is a statement made by the individual with respect to another 
person. The observed statement is not the attitude. We might certainly 
infer that this individual has negative feelings or an unfavorable attitude 
toward policemen, but we have not observed the feeling or the dislike. 
-A child who says that he hates algebra is primarily giving an expression 
of how he feels about algebra. We do not observe his feelings, however, 
only wliat he says, and. our measurement task is much more difficult 
than that involved in recording observations of reaction time. 

As a first step in assessing attitudes, then, we want to observe be- 
havior that we assume has relevance to the ubject irt which we are 
interested. 1;^ may be possible to find some situations in which spontan- 
eously emitted beha/ior would serve as an indicator of underlying atti- 
tudes. The Viet Nam War is obviously an issue which elicits intense 
emotional reaction in many individuals. What is said about this war can 
be observed, as can other behaviorij related to it, such as picketing, 
marching, contributing funds, etc. We would probably be correct in 
inferring that persons engaged in these activities have strongly unfavor- 
able attitudes toward the war. 

Aside from the impracticality of an investigator having to wait for 
spontaneous behavior to occur and then being present to record it, this 
method of assessing attitudes usually does not yield information about 
individuals with less extreme feelings. Also, as mentioned above, atti- 
tudes are only one determinant of overt behavior, and persons with 
equally extreme views may desist from action for a number of reasons. 
Observation of spontaneous behavior leaves, of course, unanswered the 
question of what attitude those who do not engage in overt behavior 
have toward some object. 

A closely related approach to assessing attitudes is to use group mem- 
bership as an indication of feelings toward some object or concept. 
Some groups are formed on the basis of specific issues-to fight water 
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pollution, promote safety laws, protest the war in Viet Nam. We could 
probably infer thiit members of the Communist Party were favorably 
disposed toward communism, with our erroneous ciassificalions consist- 
ing of a number of FBI agents. But membership in other groups is of a 
more nebulous status: joining a labor union may be compulsory in order 
to hold a job and does not necessarily mean that members have favor- 
able attitudes toward labor unions. In addition, group membership as an 
indicator of attitudes allows only a gross classification of people into 
groups. 

Because of the difficulties inherent in assessing attitudes by observing 
overt actions, or by inference from group membership, the majority of 
evaluation efforts have depended on some form of verbal response. A 
method often used is that of the survey or interview: individuals are 
asked direct questions concerning their feelings or opinions about a cer- 
tain issue, object, etc.: whether they are for or against it, like or dislike 
it, or approve or disapprove of it. When a large number of persons is 
involved, as in public opinion surveys of attitudes toward so.cial, eco- 
nomic or political issues, a sample of individuals who are representative 
of the larger population is surveyed. Various methods have been derived 
for identifying a cross-section of the population that will be truly repre- 
sentative-an important consideration to insure that no systematic biases 
are present in the results that would lead to erroneous generalizations 
about the views of the larger population. Discussions of sampling tech- 
niques may be found in Selltiz et aL (1966) and Scott and Wertheimer 
(1962). 

Questions asked in a survey may be either open-ended (e.g., '*How do 
you feel about the draft?") where the respondent answers in his own 
words and' the interviewer records the information, verbatim, or closed, 
where the individual is furnished with a set of response categories and 
indicates the alternative most closely aligned with his feelings. 

There are advantages and disadvantages to both types of questions. 
Open-ended questions permit the respondent to answer in his own frame 
of reference, giving a more detailed picture of his viev: which may aid 
the investigator in discovering attitudes that had not been anticipated^ 
prioriy or in avoiding misinterpretation. The procedure is, however, time 
consuming for both the interviewer, who must record the answers, and 
the , coder, who must describe the data obtained in a systematic' and 
objective manner. A content analysis procedure is usually required, using 
well-defined categories into which responses are coded, then tabulated. 

In contrast, closed questions are easy to administer and relatively 
quick to analyze. Respondents must answer on the dimension of interest 
to the investigator, thus limiting the number of uncodable answers. 
However, with closed questions, there is a greater likelihood that any 
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misinterpretation of questions would pass unnoticed. Also, respondents 
may choose an alternative even though they have no clearly forniulated 
views on the question; the presence of responses suggests an alternative 
to them. 

It is possible, of course, to combine the two types of questions, 
drawing from the strengths of each. One may conduct a small pilot 
study using open-ended questions to serve as the basis for constructing 
categories of response to closed question in the larger study. Using this 
procedure, an investigator is more likely to include the entire range of 
possible responses to his questions. The data obtained from the pilot 
study might also aid in the clarification of issues, the formulation of 
new questions and hypotheses, and the identification of factors relevant 
to the topic which are salient for individuals. It is also possible to 
combine the questions by asking respondents to indicate thcir feelings 
on a fixed-alternative question, such as ''Did you enjoy watching the 
film about children living in Appalachia?: (Yes or No)," and following 
{heir answer with an open-ended question such as "Why?". 

■ Those readers desiring more information on the construction and 
implementation of surveys or interviews are referred to Selltiz et al 
(1966), Payne (1951) and Oppenheim (1966). These authors discuss 
question-types, sequencing of questions, question wording, and various 
issues related to gathering data through surveys or interviews. In addi- 
tion, Cannell and Kahn (1968) give an excellent presentation on inter- 
viewing which includes discussions of sources of bias, methodological 
considerations, question design, interviewing techniques, etc. 

A consideration which must be kept in mind when asking individuals 
direct questions of any kii;d is that respondents may be reluctant to 
express their feelings publicly. If the person feels that an honest expres- 
sion of his feelings may place him in unfavorable light, or if he is 
motivated to present himself as favorably as possible (or, in some situa- 
tions, as unfavorably as possible) we may not be able to rely on his 
verbal reports. One cannot expect complete honesty or freedom of ex- 
pression regarding an employee's thoughts or feelings about his employer 
if the employer asks the questions or is present when they are asked. 
Similarly, a teacher who attempts to assess how students feel about 
various aspects of his course cannot expect complete honesty and frank- 
ness if the students believe that the attitudes they express may have 
some influence on the grade they receive. 

One possible way of reducing respondents' anxiety about expressing 
their vie\/s publicly is to administer a written questionnaire. Essentially, 
the same questions may be asked as in an interview or survey, but 
subjects can be assured of anonyriiity if the investigator so wishes. In 
addition, questionnaires may be administered to large groups of people 
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simultaneously, thus being less time-consuming and probably less expen- 
sive than a survey, while obtaining information from more people. There 
is more uniformity from one measurement situation to another when 
using questionnaires, because of their impersonal nature and standard- 
ized format. The personality of the interviewer does not influence the 
respondent, and there is more uniformity between measurement situa- 
tions. One other advantage of the questionnaire ii that the respondent 
may take more time to deliberate on his responses than when he is 
under the social pressure to respond to verbal questions. 

In using questionnaires, however, one loses the inherent flexibility of 
an interview: there is little opportunity to identify a misinterpreted 
question or an unclear answer. When the questions to be asked arc 
open-ended, respondents will usually speak more fully than they will 
write; an interview might, then, yield more detailed information, al- 
though intervieweii faced with overly verbose individuals may view this 
as a dubious advantage. 

More detailed comparisons of interviews and questionnaires may be 
found in the references cited above for interviews. These authors, with 
the exception of Cannell and Kalin, also address themselves to the issues 
specific to questionnaire design. 

Because there is less opportunity to clarify questions which respon- 
dents may not understand, an investigator, perhaps, must pay greater 
attention to question design when constructing a questionnaire. But 
regardless of the mode of inquiry, the formulation of appropriate" ques- 
tions is of primary importance, and involves a considerable amount of 
skill. Questions should be brief, clear, unambiguous and direct. 

For example, in the question, ''Do you think there should be an 
international scientific holiday?", the topic might be interpreted by 
some individuals to mean a day on which science is to be commemo- 
rated, and by other individuals as a period during which the world is to 
enjoy a respite from further scientific inquiry. 

Problems arising from differences in frames of reference between 
investigators and respondents are well illustrated by an example cited in 
Cannell and Kahn (1968). The Bureau of the Census found that ques- 
tions aimed at determining the size of the labor market consistently 
underestimated the number of employed persons. When respondents 
were asked, "Did you do any work for pay or profit last week,'' they 
answered in terms of their major activity, ignoring the explicit phrase 
"for pay or profit." Thus, housewives and college students answered 
negatively even if they were employed part time. When the questions 
were revised to allow people to classify their major activity first and 
then to indicate any supplemental work for pay, the official estimate of 
employment rose by more than a million persons. 
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Further considerations involved in question formulation are covered 
in depth by Cannell and. Kahn (1968). Although the focus of their 
discussion is on interviewing, qiiesuonnaire developers will also find the 
topics of primary importance. The authors consider (1) the cognitive 
factors of language, frame of reference, conceptual level and the impor- 
tance of using questions which embody a single idea, (2) the accessibil- 
ity issue-dealing with the respondent's possession of relevant informa- 
tion and background experiences, and (3) motivational factors, which 
■may influence the respondent's willingness to cooperate. 

The methods of assessing attitudes considered thus far in this paper 
have progressed in the degree of preciseness which they afford a re- 
searcher. We began with the observation of spontaneous behavior, 
includmg the special case of group membership, where the investigator 
makes no attempt to present a standardized stimulus condition nor to 
control the situational variables. He merely records behavior that he 
observes and has no way of identifying the attitudes of persons who do 
not engage in overt action. There is also little opportunity to measure 
the degree of favorableness or unfavorableness of attitudes; individuals 
usually must be grouped into gross categories. 

The use of verbal reports to assess attitudes was introduced through 
the surve/ or interview technique. Here, a group of individuals whose 
altitudes we wish to assess may be first identified, then presented with a 
more-or-less standardized set of questions concerning the concept(s) or 
issues in which we are interested. There is a greater likeliliood that 
individuals whose attitudes lie along the continuum from favorable to 
unfavorable will be included for study. We may be able to gain informa- 
tion on the salient factors which are relevant to individual feelings. 
Although survey data is often reported in terms of gross categories of 
response (e.g., for or against, favorable or unfavorable), some attempt 
may be made to determine degrees of difference: such an attempt is 
likely to be relatively imprecise from a technical viewpoint, however. 

The construction of a questionnaire represents a further increase in 
the amount of control which the investigator exerts over the measure- 
ment situation. Questions are presented in a standardized format, and 
there is little opportunity for the personality of the researcher to influ- 
ence responses. Depending on the purpose of his query, the investigator 
may not be wiUing to relinquish the more detailed information offered 
by an interview for the more standardized questionnaire. But from a 
measurement viewpoint, the latter technique will produce data that is 
easier, to analyze and more comparable between respondents. 

A growing need for objective measurement instruments that could be 
administered to large groups of people has led to the development of 
attitude scaling techniques. Technically superior to questionnaires, atti- 
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tude scales provide a quantitative method for assessing an individual's 
relative position along a unidimensional attitude continuum. The direc- 
tion and intensity of the respondent's attitude is indicated by a single 
score which summarizes his "responses to a series of items, each of which 
is related to the single concept, object, or issue under study. 

The procedures followed in the construction and use of attitude 
scales makes them similar to psychological tests of aptitude and achieve- 
ment. Before describing specific attitude scaling techniques, therefore, it 
might be useful to briefly discuss the nature of more familiar tests- We 
can then compare some of the differences and similarities between tests 
and scales. 

The items on aptitude and achievement tests are carefully edited and 
selected in accordance with specified criteria. As opposed to question- 
naires, where the answers to specific items are often of interest, so that 
single item scores are tallied separate items. 

The items should, of course, be relevant to the particular aptitude or 
type of achievement being measured. A test designed to measure the 
accuracy and speed with which individuals can add nunbers obviously 
should not include questions relevant to the calculus. A fundamental 
assumption guiding the selection of aptitude test items is that those 
individuals with a high degree of the aptitude are more likely to give the 
correct response th?n those with a low degree of the aptitude. 

The tests are administered under standardized or controlled condi- 
tions. Individuals are aware that there are correct answers to the items 
and thai they will be judged or evaluated in terms of the number of 
correct answers that they give. iMost respondents are presumably moti- 
vated to perform well, although it is possible to purposefully mark 
wrong answers in order to obtain a low score. A genius, for example, 
may portray himself as a moron if he so desires, but it is impossible for 
a moron to portray himself as a genius on an ability test, regardless of 
how highly motivated he may be to do so. 

Attitude scales are both similar to and different from aptitude, 
achievement, and other tests. The items in an attitude scale are also 
carefully edited and selected according to specified criteria, which wc 
will discuss below. The items in an attitude scale should also be relevant 
to the single concept or object that the scale was designed to measure. 
For example, an attitude scale designed to measure attitudes toward the 
draft should contain only those items that are clearly relevant to this 
topic and exclude those that are irrelevant. 

The major difference between a scale and a test is that individuals 
taking a scale respond in terms of their feelings about individual state- 
ments and there are no single "correct" answers. The respondents' be- 
liefs, opinions or feelings provide the criteria by which he judges the 
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"correct** answer. If a scale is designed to measure attitudes toward 
censorship, for example, individual responses of either ''Agree" or *'Dis- 
agree" to the statement, "Strong censorship laws arc a necessity" will be 
correct, depending on the attitude Oi' the respective respondents. Con- 
sequently, whereas someone taking an achievement or aptitude test may 
purposefully lower, but not raise, his score, it is possible for a respon- 
dent on an attitude scale to fake his feelings in either a positive or 
ne^gative direction. This possibility exists not only on attitude scales, but 
whenever we attempt to infer feelings from verbal reports. 

Many of the criteria for writing good questions for interviews or 
questionnaires also apply to the statements on attitude scales. They 
should be clear, brief, and unambiguous, containing only one complete 
thought, st.'-ted in a simple rather than a compound sentence whenever 
possible. Edwards (1957) summarizes other informal criteria for writing 
statements. Because the purpose of an attitude scale is to differentiate 
between varying intensities of attitudes, items must be included that 
reflect the entire range of feelings from strongly favorable, through 
neutral, to strongly unfavorable toward the topic being measured. To 
ensure adequate coverage of this continuum, scale developers often col- 
lect relevant statements from published materials, or from personal inter- 
views. 

If a statement is equally likely to be endorsed by persons with favor- 
able and unfavorable attitudes, then it obviously will not be of value in 
differentiating between the groups and should not be included on the 
scale. The likelihood that factual knowledge about a concept, object or 
issue will be equally available to all individuals precludes the use of 
factual statements on an attitude scale: individuals would tend to agree 
with the items irrespective of their attitudes. 

The criteria considered thus far for writing attitude scale statements 
are largely informal. Producing good items depends largely on the skill 
and intuition of the writer— a situation similar to that of designing a 
survey or questionnaire. But one of the major contributions of scaling 
techniques to the assessment of attitudes is the inclusion of objective 
procedures for choosing discriminating items for the final ccale from 
among a large pool of items originally gathered. The particular method 
followed in choosing final scale items varies with different scalin;^ tech- 
niques, and reliably differentiate between the attitudes of respondents. 

The two major approaches to the construction of attitude scales are 
discussed below. But it may be of value to first examine the extent of 
topics for which scales have been designed. 

An extensive collection of attitude scales that have been constructed 
by various researchers are published in a recent book by Shaw zvA 
Wriglit (1967). A sampling of some of the attitudes which these scales 
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were designed to measure may be of interest. This listing is not com- 
plete, but it does indicate the variety of scales available at this time: 
scales have been designed to measure attitudes toward: self-reliance; 
teaching; education; competition; church and religion; dating; divorce; 
mental patients; farming and various other occupations and professions; 
liomemaking activities; menstruation; birth control; movies, academic 
freedom; safe driving; mental illness; socialized medicine; censorship; 
capital punishment; school integration; segregation and desegregation, 
the acceptance of black students in colleges: vivisection; older people; 
internationalism; war; mathematics; physical education; law, justice; 
evolution; death, God; various school subjecY,s, ethnocentric attitudes; 
attitudes toward police, supervisors, probation officers; teacherii, parents, 
the mentally retarded, fraternities; labor unions and newspapers. 

In addition to the scales themselves, Shaw and Wright also provid^i 
the scoring values, scoring procedures and other technical information 
on the construction of each test. Although tlie constraints in a particular 
evaluation situation may preclude the use of an existing test, a re- 
searcher may still find this book to be a valuable source of items. 

In general there are two major approaches that have been used in 
developing attitude scales. The judgment method involves the use of a 
judging group in obtaining scale values for the items, and is most closely 
associated with work done by L. L. Thurstone. Tlie response methods, 
rather than attempting to assign scale values to items, rely on the direct 
responses of agreement or disagreement given by a pilot group of Ss to 
the entire original pool of items. Likert-type scales, named for the man 
who initiated the response method of scale construction, are the most 
widely-known. 

The majority of attitude scales have been developed by either the 
Thurstone or the Likert technique. We shall therefore describe these 
procedures in some detail both as an illustration of the differerjces be- 
tween judgment and response methods, and as an aid in evaluating the 
results of attitude scales. Several other techniques of scale construction, 
some of which reflect considerable statistical refinement and theoretical 
sophistication are described in Edwards (1957) and Fishbein (1967). 

The main purpose of the scale construction technique developed by 
Thurstone is to build an attitude scale with equal -appearing intervals 
dividing the continuum between opposing extremes in attitude. For 
instance, one may be -measuring attitudes toward campus demonstra- 
tions. The most favorable item on the scale may be ''SDS leaders are the 
heroes of today'' and the least favorable item, "Leaders of demonstra- 
tions should be shot." If the scale has been constructed by the Thur- 
stone method, the remaining items would be chosen so as to divide 
equally the psychological range between these two extremes. Thus, items 
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are chosen for the final scale whose scale values are distributed evenly 
along a continuum of favorableness-of-attilude. 

It may be helpful to an investigator choosing a method of attitude 
scale construction to note that a person's response on a Thurslone scale 
localizes his position along a continuum. The respondent will agree with 
only one or two items that reflect his attitude and will disagree with 
items lying on either side of the scale from these. This method of 
discriminating between individuals may be differentiated from Likert- 
type. scales on which the respondent indicates the degree of his agree- 
ment or disagreement with each item, then is assigned a total score 
computed by summing the subscores assigned to each response. 

The procedure in constructing a Thurstone-type scale is as follows: 

1. Gather together a large number of items (e.g. 100) that are re- 
lated to the attitude being investigated. These should reflect 
opinions all along the dimension being measured, from favorable 
through neutral to unfavorable. 

2. Reproduce the items on separate slips of paper. 

3. Choose at least 40 independent judges who are similar to those 
persons to whom the final scale will be applied. 

4. Give a set of items to each judge, in randomized order, with 
instructions to sort them into elever^ equally spaced piles, accord- 
ing to the degree of their favorableuess toward the object be/ng 
measured. Judges are to disregard their personal agreement or dis- 
agreement with the items. The most unfavorable statements are 
placed in pile No. 1, slightly less unfavorable in pile No. 2, and so 
on to pile No. 6, which should contain items that show a neutral 
attitude. Pile No. 7 then contains sliglitly favorable items and so 
on until pile No. H which contains the most unfavorable items in 
the pool. 

5. Eliminate judges as careless' or otherwise deficient in performing 
the task who have placed more than 30 statements in one pile. 

6. Compute .the scale valv.e of each item by taking the median or 
mean position to which it was assigned by the judges. Items with a 
scale value above 6 are those which ani judged, on the average, to 
be favorable and those V/ith a scale value below 6, on the average, 
are judged as being unfavorable. 

7. Eliminate items as ambiguous or irrelevant that were placed in 
piles too widely scattered by different judges. The variation in the 
distribution of judgments for each item may be determined sta- 
tistically by computing the interquartile range, or Q. When the 
judges agree on the placement of an item, Q will be small, com- 
pared to its value when there is relatively little agreement among 
judges. 
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8. Select items (usually about 20) for the final scale whose scale 
values are spread out evenly along the continuum fron: extreme in 
attitude to the other. If more than one item has the same or 
similar scale value, the item with the smaller Q should be chosen. 
The final items are printed in (usuaJly) random order without their 
scale values and respondents are asked to check those statements with 
which ihey agree. Presumably those individuals with favorable attitudes 
will agree with statements that have favorable scale values, and individ- 
uals with unfavorable will agree with items that have unfavorable scale 
values. An individual's score is computed as the mean or median of the 
scale values of items with which he agrees. It is interpreted as indicating 
his position on a scale of favorable-unfavorable attitude toward the topic 
being investigated. 

The judging procedure developed by Thurstone resulted from his con- 
cern for devising a scaling technique that would divide the psychological 
continuum between opposing extremes in attitudes into equal-appearing 
intervals, Likert*s main concern, however, was with the unidimension- 
ality of the measure-attempting to assure that all of the items measured 
tlie same common factor. 

The procedural steps in building a Likert-type scale are as follows: 
: 1. Collect a large pool of items which are either clearly favorable or 

cleariy unfavorable to the concept being measured. 

2. Administer these items to a pilot group of about 100 persons who 
are representative of tlie population to whom the final scale will 
be applied. Ask each respondent to indicate the degree of his 
agreement with the item on a (usually) five-point continuum rang- 
ing from "strongly agree" to "agree," "uncertain,*' "disagree" and 
"strongly disagree." 

3. Assign scores of 1-5 to the response categories for each item such 
5 that ] will reflect a strongly unfavorable attitude and 5 will reflect 

a strongly favorable attitude. The direction of the scoring weights 
assigned to the response categories will depend on whether a par- 

i ticular statement is favorable or unfavorable. Thus, if a statement 

is regarded as being favorable, scoring weights assigned to the five 
categories would be 5 for a "strongly agree" response, 4 for an 
"agree" response, 3 for an "uncertain," 2 for a "disagree" re- 

\ sponse, and 1 for a "strongly disagree." 

If a statement is regarded as being unfavorable, the direction of 
the scoring weights is reversed (e.g., "strongly agree" receives a 
score of 1 and so on). 

4. Compute the total score of each individual by summing the sepa- 
rate weights assigned to his responses over all items. Individuals 

^ with favorable attitudes will presumably tend to give "agree" and 

ERIC 
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"strongly agree" responses to favorable items and ''disagree" and 
"strongly disagree" responses to unfavorable items. Consequently, 
they will obtain relatively higli total scores. This situation will be 
reversed for persons with unfavorable attitudes. 

5. Identify high and low s orers-i.e., those respondents whose scores 
fall in the upper and lo -er quarters of all the .scores. 

6. Compare the responses of the high and low scorers to each item. 
Statistical techniques, such as t-tests between the means of high 
and low scorers on each item, or correlational methods, may be 
used to identify the most discriminating items. However, a simple 
procedure may suffice to obtain the same ordering of statements; 
compute the difference between the means of the high and low 
scoring groups on each statement and retain those items (usually 
about 20) for which this difference is greatest. 

The final scale is thus derived from those original items which most 
clearly differentiate between persons holding a favorable attitude and 
those holding an unfavorable attitude. 

On the final scale, responses are again scored from 1-5 on respective 
categories ranging from "strongly disagree" to "strongly agree'' for fa- 
vorable items and the reverse is true for unfavorable items." An indi- 
vidual's total score is taken as the sum of the weiglits assigned to his 
individual item responses. This score reflects the degree of favorableness 
of his attitude, and ranks him in relation to other persons on the scale. 

There is some evidence to show that if the same set of items is used 
to construct attitude scales by both the judgment and the response 
methods, scores on the two scales will be highly correlated. Both types 
of scales tend to have relatively high reliability coefficients and choice 
of method is more or less arbitrary. Both types of scales provide for a 
relatively wide range of scores, and consequently, relatively good mea- 
sures of individual differences. 

Another technique that has been used to measure attitudes is the 
Q-sort, developed by Stephenson (1953). The Q-sort, while most fre- 
quently used in personality assessment, may be broadened in application 
to measure individual feelings or attitudes toward any subject. Its pur- 
pose is to obtain a picture of an individual's unique view of what is 
being considered by asking him to sort a large number of statements 
relevant to the topic into piles reflective of a range of opinion. The 
procedure is thus very similar to the judging process in constructing a 
Thurstone scale. 

Q-sorts may be used as a ranking method in which statements that 
are relevant to the topic under consideration or descriptive of person- 
ality characteristics are compared with one another and placed in piles 
along a continuum. They may also be used as self-descriptive devices. 
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where the continuum of piles into wliich statements are sorted ranges 
from "most like me'' to "least like me." More than one Q-sort may be 
obtained from an individual in order to assess any changes that may 
have taken place in his attitudes over time, perhaps as a result of some 
experimental treatment given between measures. For instance, Q-sorts 
may be used to determine an individual's attitudes toward some topic 
before and after he is exposed to a persuasive message. Or, one miglit 
ask a teacher to make Q-sorts for his pupils several times during a year 
with respect to their adjustment and reactions to school situations. 
The steps to be followed in devising and administering a Q-sort are: 

1. Determine the criterion by which sorting is to take place, (e,g., 
degree to which the item describes tlie sorter; agreement/disagree- 
ment with the item, etc.). 

2. Collect items (sentences, phrases or words) relevant to the task. 
Usually, from 50-100 items are used. 

3. Determine the number of categories or intervals into which items 
will be sorted. 

4. Determine the number of items to be placed in each category such 
that the final distribution approximates a normal curve. For in- 
stance, if 60 statements are to be sorted into seven categories, the 
number of items to be placed in each category would be assigned 
as follows: 

Strongly Strongly 
Disagree Agree 
Category 1 2 3 4 5 6 7 

Number of Itenns 3 6 12 18 12 6 3 

Refer to a normal curve table (printed in most statistics texts) if 
needed. 

5. Give cards containing one item each to the subject, with instruc- 
. tions for sorting according to (1) the criterion, (2) the number of 

piles and (3) the number of cards to be sorted into each pile. 

Scores as assigned to the successive categories according to the degree 
of favorableness or descriptiveness of items to be sorted into each cate- 
gory. For example, if nine categories are used, the one containing 
strongly unfavorable or least-descriptive statements would be assigned a 
score of 1 and so on to a score of 9 for the most favorable or most 
descriptive category. The individual statements then receive the score 
assigned to the category into which they are sorted. 

When more than one Q-sort has been obtained from the same set of 
items, correlations may be computed to explore the degree of relation- 
sliip between the sets of responses. For example, correlations may be 
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used in a pre-post design to investigate the change in an individual's 
sorting pattern after some experimental treatment, such as a motion 
picture. Or, comparison between sortings, such as the relation between 
self-image and ideal image, may be made. Correlations may also be used 
to compare a given individual's views about various topics, e.g., different 
school subjects, or to compare the views of different persons about a 
given topic. 

In addition, a defining Q-sort may be obtained by asking a group of 
judges to sort the statements so as to describe a person holding an 
extremely favorable attitude. If the judges agree, their individual Q-sorts 
will be positively correlated, and an average rating can be computed for 
each statement; these averages can then be used to form a criterion, or 
defining, Q-sort. Individual Q-sorts may then be correlated with the 
defining Q-sort; the resultant correlation coefficient is regarded as the 
individual's score. The higher the positive coefficients, the closer ths 
individual's position corresponds to the judges' view of an extremely 
favorable position. Negative correlations presumably would indicate an. 
unfavorable attitude. 

The final method of assessing attitudes that will be discussed here is 
one which has gained widespread popularity in recent years, partially 
because of the minimum of time and effort involved in constructing it. 
This is the Semantic Differential, originally developed by Osgood, Suci, 
and Tannenbaum (1957) as an objective method for measuring the con- 
notative meaning of a concept or object to an individual. Subjects rate a 
given concept or object on a series of seven-point bipolar rating scales, 
with each pole defined by an adjective, e.g.. Beautiful : : Ugiy. 

In the developmental stages of the technique, Osgood et al., iden- 
tified three basic dimensions of meaning represented by sub-groups of 
scales from the responses of many persons toward diverse concepts and 
objects. Sets of scores were submitted to factor analysis, and the results 
showed rather consistent clusters of scales around the following three 
dimensions: (1) Evaluative-whether the individual views the object or 
concept favorably or unfavorably; (2) Potency-the individual's percep- 
tion of the power of the object or concept, and (3) Activity. Exemplary 
groups of bipolar scales which have been shown to reflect these basic 
dimensions of meaning are, respectively, (1) fair-unfair, clean-dirty, 
good-bad, valuable-worthless; (2) large-small, strong-weak, heavy-light; 
(3) active-passive, fast-slow, hot-cold. 

It seems that certain scales, such as "hot-cold," which has been 
shown to group with scales on an activity dimension, reflect a rather 
subtle feeling-tone toward the object or concept being rated. 

Although the Evaluative dimension is the strongest, accounting for 
the largest percentage of the total variance in individual's responses, the 
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inclusion of scales representing the Potency and Activity dimensions 
provide somewhat more information regarding individuals* attitudes. 
There may be little correspondence between ratings of a concept or 
object on the different dimensions. For instance, in an early study utiliz- 
ing the technique, Osgood et al. (1957) studied the meanings of several 
political concepts (e.g., Taft, Truman, Socialism, the Atom Bomb, 
Stalin, Policy in China) to three groups of people. One of the results 
was that Stalin was rated very low on tlie Evaluative dimension, but 
high on the Potency and Activity dimensions. As another example, we 
might expect "white rose buds" to be rated as favorable, but unpower- 
ful and inactive. These examples illustrate the necessity of interpreting 
scores on the Semantic Differential within the framework of the con- 
cept(s) or object(s) being rated. Whereas high scores on the Evaluative 
dimension reflect a favorable attitude, high scores on tlie Activity and 
Potency dimensions may carry quite different meanings. In some cases, 
investigators have chosen to obtain ratings only on the Evaluative dimen- 
sion, which corresponds to the favorable-unfavorable dimension mea- 
sured on other types of attitude scales. 

In using the scales, a respondent is asked to rate a given concept- 
e.g., a political institution, a person, an issue, work of art, etc.— on a 
series of the bipolar scales. The concepts to be rated are chosen so as to 
fit whatever problem is being investigated. Whereas most concepts to be 
rated are presented as single nouns, investigators have also used noun 
phrases, adjectives and a variety of nonverbal stimuli, such as TAT pic- 
tures, Rorschach cards, paintings, sculptures and sonar signals (Osgood 
al, 1957). The method has found application in the areas of personality 
research, communications, advertising research, as well as attitude mea- 
surement. 

The procedure in constructing a Semantic Differential is as follows: 

1. Determine the concept(s) to be rated. The number and type 
chosen will depend on the problem being investigated. 

2. Choose appropriate bipolar scales. (At least three scales each from 
the Evaluative, Potency and Activity dimensions are recommended. 
Osgood's work typically uses 10 scales, although number and type 
of scales will vary with the particular question under study.) 

The researcher may be required to define his own scales. 

3. Design response sheets: 

a. Use one page per concept to be rated. 

b. List the concept at the top of the page. Concept orders for 
different respondents may be randomized. 

c. Place bipolar scales below the concept name. 

(1) Ordering of scales on consecutive pages (concepts) remains 
fixed. 
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(2) A constant polarity direction for each scale is maintained on 
consecutive pages. 

(3) Scales drawn from a single dimension are alternated in 
polarity direction (e.g., good-bad, wortliiess-vaiuable). 

(4) TIie order of scales representing different dimensions is ro- 
tated. Example: 



good : : : : ; : : bad 

mild : : : : : : : intense 

active : : : : : : : passive 

interesting : : : : : : : unniteresting 

worthless : : : : : : : valuable 

strong : : : : : : : weak 

colorless : : : : : : : colorful 

fair : : : : : : : unfair 

shallow : : : : : : : deep 

restless : : : : : : : quiet 



4. Write instructions, to include: 

a. general orientation to the task. 

b. the significance of the scale positions and how to mark them 
(no ornissions, check marks in center). 

c. attitude toward the task (speed, first impressions, independence 
of judgments). 

In analyzing the data quantitatively, the usual procedure followed is 
to assign values from -3 to +3 or from I to 7 or the rating inteivals 
lying between adjective pairs, such as that the interval closest to the 
adjective representing negative evaluation, low potency, or low activity 
receives a score cf -3 or 1, anJ the interval lying closest to the oppos- 
ing adjective receives a score of +3 or 7. The successive integers repre- 
sent the points in between (e.g., the scale point nearest "cold" receives a 
score of —3 or 1; the point nearest ''hot" receives a score of +3 or 7, 
with the successive integers representing the points in between. 

An mdividual's score on each scale for each concept may then be 
assigned in terms of the scale positions that he has checked. The indi- 
vidual's rating of the concept on each of the three principal dimensions 
(Evaluative, Potency, and Activity) can be assessed by averaging his 
scores for the respective sub-group of scales belonging to each dimen- 
sion. Thus, on a scale with scoring weights from —3 to +3, a given 
student's attitude toward a particular educational film may rate 3 in the 
Evaluative dimension, .5 in Potency, and 2.1 in Activity. 

Responses obtained on the Semantic Differential may be used to 
compare an individual's attitudes toward different concepts, for exam- 
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pic, a lecture on history versus a fihri. Similarly, one may compare two 
.individuals' ratings of a given concept. Ratings given by groups of people 
can be arranged in order to assess differences in attitudes between 
groups, or toward various concepts within the group. The same concepts 
may also be rated at diffe. V. points in time, to assess any changes in 
attitudes that take place. 

There is some evidence to indicate that attitude scores obtained with 
the Semantic Differential are positively correlated with scores obtained 
on other attitude scales. 

Educational media represent a potentially significant means fur influ- 
encing the formation and the modification of attitudes. Although the 
methods of assessing attitudes that are presented in this paper are not 
exhaustive, it is hoped that the educational media technologist will gain 
some insight into the various tools available to him in assessing the 
effects of his materials and in designing programs for instructional use. 
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The intent of this chapter is to present to the technologist reader: 

• An orientation for using learning games and simulations to pro- 
duce affective responses, and 

• A discussion of a moderate number of affect-producing simulation 
and gaming strategies. 

When you have completed the chapter, you should be able to construct 
nimbly and with a warm pleasant flush of positive affect, solutions to 
the following kinds of instructional problems: 

^ A social science teacher in South Dakota wants some help to get 
her 6th graders interested in the problems of the European Com- 
mon Market. 

• Your mother-in-law, who teaches high school English to a lower 
socio-economic class complains that she can stimulate no inter- 
action between students and subject matter. 

• The President of Death Valley University asks you to develop an 
instructional package to gain student support, and empathy, for 
his position. The package must be portable, self-instructional, and 
adaptable to individual, small or large group instruction. 

To assist you in achieving such perceptual orientation and skill, the 
authors will be routing you along three successive steps: 

• An expository review of what simulation and educational gaming 
is all about; 
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• A suinmary higlilighting the kind of affective outcomes that ap- 
pear most susceptible to simulation and game techniques; 

• A series of affect building and repair hints for the apprentice 
gamesman. 

The authors appear to be fascinated by each sentence in the chapter. 
However, in the event you feel engulfed in more information about 
simulation and games tlian you wanted to know, we have provided 
fail-safe exits at convenient points throughout the chapter. If you feel a 
need to depart at times, please use these marked exits.f 

/. Review of Simulation and Gaming ^ 

Simulation and games may be the hottest act in the educational 
circus judging from increasing attention and interest. In 1969, Education 
USA ^ stated that educational games "may be the beginning stages of an 
important new movement in education." The ioum^l. Social Education'^ 
receives more manuscripts on simulation than on any other topic. In the 
last year or two, it is reported that the United States Information 
Agency (USIA) featured several of the WFF 'N PROOF instructional 
games in their Tenth Cultural Exchange Program entitled "Education 
USA in the Soviet Union".^ 

Ancestors of the Innovation 

The innovation called "simulation and gaming" may be traced to at 
least three ancestors: simulators, games, and role-playing. The ancestral 
list may be longer, but for present purposes, these three will suffice. 

Simulation has been defined in the most general terms as the ob- 
taining of the essence of something, but without all aspects of reality 
(cf., Thomas and Dcemer, 1957). Simulator t}'ainers illustrate this defini- 
tion admirably. A pilot trainee may learn to fly an airplane by use of a 
simulator that even provides the appropriate visual stimulus of a runway 
that informs him whether he |s too low or too high, or off-center. If a 
real-l'fe plane were used, practice landings would be most hazardous for 
the novice and distasteful to his copilot and navigator, not to mention 
the expense of taking the craft '^ff the ground. Yet, the computer-con- 
trolled simulator provides the essence of flying without Uie hazard. The 
attempt here is allow the trainee to experience vicariously what he 

^Education USA, Washington, D. C.:\ National. School Public Relations Associa- 
tion, February 17, 1969. 

'^Social Education, 1969, Vol. 33, No. ;2. 

^The WFF W PROOF Newsletter. Turtle Creek, Pa.: WFF 'N PROOF, Fall 
1969. 

t Fail-Safe exit points are shown in the mar[^ns as:^-^ and re-entry points as:'^A§ 
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eventually has to experience in the real-life, world. Some aspects of 
reality are omitted, while other aspects are represented. 

Games may be thought of as competitive encounters between indi- 
viduals that involve some degree of skill and/or luck. Games have been a 
pait of most cultures for some time, and are usually looked upon as a 
quite pleasant (or even stimulating) diversion. One cannot deny that 
leaving a game of chess uncompleted to perform more mundane tasks 
may be quite jarring (at least for the avid player). Excellont theoretical 
discussions of games are available elsewhere for the serious student (cf.. 
Luce and Raiffa, 1957). 

Role-playing is taken by some to mean the depiction of characters in 
scenes for illustrative purposes. For example, an instructor mry stage a 
proper interview approach in a course of training for a team of research 
workers. Others take role-playing to mean the same thing as sociodrama, 
which in its original meaning, refers to a therapeutic technique that 
involves groups as compared with psychodrama, which is a therapeutic 
technique for individuals. Still others equate role-playing with "let's pre- 
tend" or "play-acting'\ Grambs (1958) defines role-playing as "unpre- 
pared, unrehearsed, dramatization". In any e^':jnt, all of the various 
definitions of role-playing center mainly around the development of 
deeper understanding of social relations. The practice of experiencing 
the actions and feelings of someone else is typified in most simulation 
games. For example, when a learner behaves as though he were a senator 
in :i legislative assembly, clearly, he is "being someone else". 

From these three rather different ancestors-the simulator for train- 
ing, the game for entertainment, and role-playing for understanding 
one's self and others-has evolved the educational innovations that now 
are grouped under the heading, "simulation and gaming". No attempt 
will be made here to justify what innovations belong in the list, and 
which do not. For the most part, making sense out of the field of 
simulation and gaming conceptually in an attempt to justify any group- 
ing of techniques under the label soem rather unsatisfying (cf., Tansey 
and Unwin, 1969, pp. 3548; Twelker, 19G9, pp. 18-45). The tack to be 
taken here is to arbitrarily single out three types of techniques that are 
usually considered as representative of the innovation, and relate these 
to the three ancestral roots identified above. The three techniques are* 

Media-Ascendant Stimulation-iechniques that emphasize learning 

through vicarious experience usually mediated by machines, films, 

pictures, etc. 

Interpersofial-Ascendant Simulation-iedmiques that are characterized 
by decision-making, role-playing, and player interaction 
Non-Simulation Games-iochmques that feature a competitive context 
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for learning concepts and principles drawn from formal disciplines 
(sometimes referred to as motivational games). 
Although these categories are not foolproof, they do serve as a "bench- 
mark" for exploration into the innovation. Perhaps a few examples 
under each category would be helpful: 
Media-Ascendant Simulation 

Classroom Simulation (Teaching Research) 
Teaching Problems Laboratory (SRA)"^ 
Simulator Trainers 

Simulation of Dental Emergencies (Teaching Research) 
"One-man" Computer Games, e.g., Sierra Leone Development 
Project 

Interpersonal-Ascendant Simulation 

Most Social Studies Simulation Games, e.g., 
"Manchester" (Abt Associates) 
"Consumer" (Academic Games Associates) 
"Tracts" (Instructional Simulations, Incorporated) 
"Inter-Nation Simulation" (SRA) 

Most Management Games 

Planning Exercises 
Non-Simulaiion Games 

"WFF 'N PROOF" 

"Equations" (Wff 'n ProoO 

"Propaganda" (Wff 'n ProoO 

Get Set Games for Beginning Readers (Houghton Mifflin) 
The table below summarizes the ancestral heritage for each category: 

Technique 



Ancestor 

Simulation 

Gaming 

Role-Playing 



Media- 


Interpersonal- 


Non-Simulation 


Ascendant 


Ascendant 


Game 


Simulation 


Simulation 




Yes 


Yes 


No 


Depends on 


Yes 


Yes 


Technique 






Depends on 


Yes 


No 


Technique 







Instructional Uses of Simulation and Gaming 

For Presenting Information. The non-simulation game is an excellent 
vehicle for presenting information, or more precisely, providing oppor- 



^At least those portions involving media 
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tunities for learners to acquire or organize knowledge. For example, the 
game of "Equations" gives learners the opportunity to use various math- 
ematical operations such as addition, subtraction, multiplication, and 
division, in a variety of situations, all determined by tlie chance throw 
of cubes and any rule variations agreed upon by the players. On the 
other hand, simulations ranging from models (and even motion pictures), 
in-basket type exercises, and games may be used to present information, 
not only for training and instruction, but for indoctrination and demon- 
stration. It should be made clear, however, that the simulation exercise, 
whether media-ascendant or interpertonal-ascendant, is geared more to 
problem-solving, information treatment, manipulation and use, and deci- 
sion-making type outcomes than for information acquisition. 

For Exercising Skills. For this use, the simulator trainer has few 
equals if practice demands a realistic environment. The training of pilots 
in simulated aircraft has been alluded to above. In civilian education, a 
unique application of mediated simulation is found in the "Classroom 
Simulator" developed at Teaching Research (Kersh, 1961; 1963a; 1963b; 
Twelker, 1967). Their classroom simulation creates for the pre-service 
teacher during the sequences is employed in sixty different problem 
sequences mediated on sound, motion-picture film. In each case, the 
student teacher is expected to react to the film as though he were in a 
j3al classroom. 

In this simulated classroom, the pre-service teacher faces a 10 foot 
square screen on which filmed episodes of children appear life-size and 
just as active. What the children do in the film sequence depends upon 
the action taken by ths trainee. Doing nothing, for example, is followed 
by very noticeable responses by the youngsters. Pre-service teachers who 
have been through the program report that if they failed to make a 
prompt and decisive move, on occasion "all hell broke loose." Classroom 
simulation is based on the supposition that exposition of educational 
^ : methods or principles could be expected to help the teacher talk about 

teacliing, but classroom experience (simulated or real) could train the 
beginning teacher to teach. It has been suggested that classroom simula- 
tion in this form helps students practice the discriminating of cues that 
signal potential problems that require immediate attention, make deci- 
sions in simulated conditions without fear of censure or embarassment, 
and to modify their behavior on the basis of this feedback (Twelker, 
1967). 

Another example of the use of simulation for the exercise of skills is 
the familiar management decision-making simulation. Participants "make 
believe" or play decision-makers of competing companies in a hypo- 
thetical or real industry. To watch the players absorbed in the simula- 
tion reveals intense involvement in analyzing tables and charts, project- 
O ing prefits (and losses), and recommending output rates, sales strategies, 

ERJC 
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and prices. Properly structured, a simulation game can provide quite 
realistic opportunities for the practice of executive decision-making. 

For Assessing Performance. A third aspect of instruction where simu- 
lation is of use is in the assessment and evaluation of performance. The 
assessment of performance may be carried out using simulation in all 
sorts of activities, and offers a unique opportunity to assess performance 
in a life-like setting that is often times untestable by other means. For 
example, it is difficuh to think of a paper-and-pencil test as being ade- 
quate to test the perfornlance of astronauts in a space vehicle coupling 
activity. 

In-basket tests 

Russell Sage Social Relations Test 

Patient Management Simulation (American Board of Orthopedic 
Surgery) 

Motion Picture Tests 
Schalock and his colleagues (Schalock, al 1964; Beaird, 1967) 
have shown that as test stimuli become more representative of the be- 
havior to be predicted, and as the opportunity for response approaches 
the freedom characteristic of life situations, the power of prediction 
increases. Tests were developed to predict teacher-classroom behavior. 
The simulation test consisted of filmed episodes of typical classroom 
problems. Student teachers were forced to react to these. Results of this 
simulation test were compared with typical paper-and-pencil question- 
naires. Beaird points out that "the extent to which prediction was pos- 
sible with the more life-like test is essentially unprecedented in the 
educational and psychological literature". He goes on to state that at 
least 50 percent of the variance in the criterion that was being predicted 
to was accounted for in each of fifteen separate criterion measures that 
represent a concrete teacher behavior iii the classroom, and as much as 
75 percent of the variance was accounted for in some instances. The 
question of simulation for performance evaluation is discussed further 
by Gagne (1954; 1965), and Frederikson (1957), Thorndike (1947), 
Gibson (1947), and Schalock (1969). 

Clinical Uses of Simulation and Gaming 

A further set of relatively unexplored possibilities for simulation and 
gaming lie in the areas discussed below, see Crawford (1968). 

For Diagnosis. Some use has been made of simulations as screening 
devices in professional education (Levine and McGuire, 1968; McGuire, 
1968; University of Illinois, 1967) and as part of a criterion test via the 
critical incident technique (cf., Frederiksen, 1962). However, their 
employment to measure aspects of personality has not been pursued. 
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Simulations offer powerful advantages as contrasted to the conven- 
tional testing instruments: 

a) Realistic problems can be presented with all the attributes th?t 
tend to give them impact. The usual verbal and pictorial instn • 
ments are necessarily abstracted with much of the affect-prod\icir 
elements omitted. 

b) The sequences of the subject's interactions and moveS; and a series 
of his perceptions, decisions, actions and subsequent perceptions 
of his own decisions and their consequences can be made visible. 
Furthermore, these observations can be sustained for lengthy peri- 
ods as required or even replicated. 

c) The range of possible stimuli to he. used can be definitely ex- 
panded. For the nonverbal or higlily disturbed subject this may be 
a crucial aspect of diagnosis. 

d) The combination of simulation with modern audiovisual recording 
allows for obtaining direct and replicable responses. The disad- 
vantages usually associated with examiner interpretation and cod- 
ing can thus be minimized. 

For therapy. Many game-like processes have been incorporated into 
various approaches to therapy. Role-playing and the expressions of feel- 
ings have been the primary emphases. However, little effort has been 
given to the combination of such affect with rational decisions, examin- 
ing consequences from those decisions, etc.; that is, the pattern used by 
a typical simulation game in which other aspects than pure feeling are 
emphasized. The advantages of the development of such graded series of 
simulations in which the introduction of usually avoided feelings and 
decisions is gradually made to the client, offers an approach consonant 
with learning theory and one that may be practicable in terms of thera- 
pist time. It is quite feasible that the newer learning games may teach 
and therapy games may heal without the continuous intervention of 
skilled professionals. 

For Measuring the Effects of Therapy. The treatment outcomes of 
psychological problems has been most recalcitrant to evaluation. The use 
of simulations to measure the degree to which people have changed 
under treatment presents new possibilities for the controlled introduc- 
tion of those complex and realistic setting factors which have thus far 
clouded attempts to measure outcomes. 

We miglit, for example, develop a series of pre- and post-tests that 
would incorporate various problem situations based on initial problems 
before and after treatment could be carefully analyzed. One advantage is 
that stressful and motivating conditions are readily and unobtrusively 
introduced into simulation exercises so the tendency for client responses 
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to reflect socially desirable ^atcomes rather than his real way of han- 
dling the problem can be minimized. 

For Promoting Positive Growth and Health (Not Simply for Curing 
Mental Illness or Healing Weaknesses). Learning games offer a productive 
mix of cognitive and affective interactions for increasing human poten- 
tial. Combinations of strategic problem-solving, artistic creation and the 
feelings of joy and ecstasy usually associated with the pexks of human 
achievement may be more readily accessible through a series of planned 
simulations. Simulations offer a chance to introduce the complexity re- 
quired in a carefully graded series of learning encounters designed co 
promote rapid growth and learning, maximizing transfer. 

For Healing Intense Social Conflicts. Many social problems are based 
on intense disagreements about values, attitudes and perceptions of 
others' roles, but solutions are slow in attainment. The employment of 
simulation games offers a chance to get key participants involved and 
cognizant of the outlook and the problems of others in a deeper way 
than the mere cognitive identification or naming of the other person's 
views. The use of such games to first broaden understanding and then 
develop cooperative solutions may be a promising one for labor-manage- 
ment, student-administration, and black-white difficulties. 

//. What are the Affective Outcomes? 

The evidential support for affective outcomes is composed of low 
grade oie. Much of it is accrued from direct observation by hardly 
disinterested game developers and instructors, from oral reports of feel- 
ings given by students to staff after a game, and from jerry-built paper- 
and-pencil questionnaires. Exceptions to this are in the minority, al- 
thougli more respectable observation reports are beginning to be pub- 
lished. The evidence concerning the affect of games is about as sound 
and as weak as the evidence for the affect produced by any other 
educational innovation, 

However, there are consistent themes reported by observer after ob- 
server. Occasionally these are buttressed by: 

1. data from attitude scales 

2. unobtrusive measures of attendance, time spent in free-choice al- 
ternatives, related books and materials sought in libraries. 

The individual pieces of evidence are weak. But streams of evidence 
point in the same general direction. The affective outcomes which we 
will identify have been repeatedly reported across observers, games, 
classes of learners and repeated trials. Members of our own staff and 
others from various institutions have observed these. The following af- 
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feclive outcomes represent, in our best judgment, good working hunches 
as an initial basis. 

Affective Outcomes of Simulation Games 

Involvement 

The affective behavior that has impressed game developers and dis- 
interested observers alike, has been the intense involvement of the parti- 
cipants. Complete absorption in the game activity, obliviousness to other 
events and time is repeatedly observed across a range of learners and 
games. 

In a classroom learning game most students do not lun for the door 
at the sound of the bell or typically, get ready to leave before it rings. 
It's often difficult to eject them from the room at the end of the 
period. We have conducted games for junior higli school students after 
school on their own time, starting at 2:00 p.m. and were forced to close 
the game down and oust players at 6:00. In the Armed Forces, it was 
reported that a player fell from a raised platform during a simulation 
game. The player broke his leg and lay supine for ten minutes before his 
teamates noticed him. 

Our own staff has observed games where gray-haired school adminis- 
trators, in the presence of their own teachers, grasp each other by the 
coat lapels and shake vigorously. Peter Winters (quoted in Twelker, 
Crawford, Wallen, 1967) reported that the Carnegie-Tech Business Game 
became so absorbing to the graduate students and staff that they began 
extending its play month after month, until it threatened to engulf the 
entire curriculum. 

This involvement often persists well after the playing period. College 
participants report carrying on the games at nights in the dorm and 
through the weekend. A high school senior speaks to this point in a 
filmed interview (Wallen, Crawford and Twelker 1967). 

The thing about the games is that you don't just quit at the 
end of the period and go to your next class. You keep on 
playing the game-in the hall and in your other classes. And 
. after school, you'd say to people, 'I'll do this for you, if you'll 
do this for me.' You just can't stop the game. 

Emotion 

The typical feeling most apparent during games is the mild elation 
accompanying absorbed progress toward a goal. However, peaks of ecs- 
tasy, rage, and shock are not atypical. Expressions of intense joy are at 
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first associated with major goal achievements. After continued play, they 
arc evinced at, the completion of a strategic move (one wliich probably 
leads to a goal). 

Positive emotions however, are not always the case. In some games, 
serious losses of player resources occur. During an inservice training 
workshop using Cmis, a political game, a liigli school teacher lost not 
only his position as national leader, but his entire nation. The player 
went into a state of shock for approximately 20 minutes. He turned 
pale, refused to leave his seat at the table, addressed no one in par- 
ticular, but kept repeating 'They can't do this, this can't be done, they 
can't do this." The other players in the game, some thirty odd, finally 
continued the game around him, bypassing his table. ^ 

An outcome that is most noticeable with younger children, par- 
ticularly disadvantaged children, is their sustained attention during the 
game. For exarple, most observations suggest that a few minutes is the 
limit for preschoolers attention to language exercises (Bereiter 1966) but 
four year olds will play highly cognitive language games for over thirty 
minutes with no loss in attentiveness. Experience with urban disad- 
vantaged learners suggests that the prospect of engrossing dropout stu- 
dents in the history of the mercantile system, for a four-hour stretch, 
may be sliglit. It has been done with the Triangle Trade game.^ 

Perception of Others 

Students often report that their perception of others has changed 
following the game experience. This is most evident when the partici- 
pant has been placed in the other person's position during the game e.g., 
a dropout, diplomat, businessman, etc. Usually, the change is in the 
direction of increased and sympathetic awareness of the pressures on the 
other person, the constraints he was forced to operate under, and the 
multitude of factors with which he had to cope. From an extreme 
example, still don't agree with them. But, they don't seem so ridicu- 
lous any more. Given their point of view some of the things they say 
and do make sense."'' 

Students have frequently observed that they didn't realize the pres- 
sures decision-makers were under until they played role. This effect 
achieved by standing in the other man's moccasins is probably not due 

5 For tire clinically minded, he appeared to recover. Wc have met him at later 
training sessions .in which he continually requests another *urn at that particular 
game. 

6a history game designed by Durham and Crawford (1969). 
7 A professed ultraliberal high school student was involved for several weeks as 
a far-out rightwinger in a political game,. 
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solely to the free role-playing, dramatic component of the game. Being 
caught up in the same cognitive, decision-forcing system is another im- 
portant component, and is evidenced by being forced to operate with 
the resources of the other, making decisions in liglit of the information 
available to him, and following the same constraints. 

Anitudes 

The attitude change possible through learning games extends well 
beyond sympathy and understanding, toward a particular person. At- 
titudes toward principles and social issues are influenced by game par- 
ticipation. Examples of objects toward which attitude changes have been 
measured following participation in learning games include: 

1) a broader role for women; 

2) the importance of community planning; 

3) diplomatic negotiations. 

Attitude change is not restricted to accepted standards of social 
demands. In one game students enact the roles and make decisions re- 
quired by the early Yankee molasses, rum and slave trading triange. 
After the game most students appear to develop a pro-slavery attitude. 
The students justify slavery, using the same arguments that are cited 
during that historic period. This pro-slavery attitude has been resistant 
to one-hour discussions and interrogation sessions by our own staff. We 
are now designing an antidote game— the same scenarios, but from the 
early African poira of view. 

The change in attitude is frequently unobtrusive to the learner. The 
attitude is not specifically identified and he is not told that he needs to 
change his attitude. Often he is not presented much chance to object or 
quarrel with the proposed change. It is slipped in as a side-affect of his 
assigned role, but reinforced repeatedly at different levels. Thus change 
is made somewhat unconsciously and imperceptably, the way enduring 
attitudes in the learner's own life have been developed. 

There is evidence that favorable attitudes tend to develop toward the 
particular subject content of the game itself, and occasionally to some 
degree toward the overall academic area e.g., social studies, economics, 
etc. The fervent prayer of leaders in gams development is that extensive 
use of games will result in more favorable and stable attitudes toward 
school and learning. The hope is still viable but inconfirmed. 

Attitudes toward the instructor may change. In most educational 
games the instructor's role shifts from center to off stage. He is no 
longer judge, jury, and the fountain head of information and precepts. 
The rules of the game and the players occupy the stage. The teacher can 
serve effectively as a consultant or coach. 
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Self Perception 

The crucial feelings for many learners may focus more with them- 
selves than with external objects and events. Do learning games influence 
one's self-perception and attitudes? 

One aspect of self-perception which has captured the attention of 
game developers has been feelings of self-efficacy. "Control of destiny" 
is the romantic title frequently applied to such feelings. In most games 
each player can make a noticeable difference in the outcomes by his 
own moves. Consequences of his moves are apparent and often dramatic. 
His decisions do make^n impact on the game environment and his own 
future in the game. The nurturance of such feelings first in the game, 
then to the sphere of activity simulated by the game, and then to a 
generalized ''I am the captain of my fate" outlook has spurred game 
developers. This-goal still beckons. 

Expression of Feelings 

Participant communications in a learning game can and do become 
highly loaded with feeling content. Expressions of personal satisfaction, 
distrust, a need for dominance, a quest for structure, a request for 
support are frequent and visible during the play. Sometimes the game 
resembles a group projective technique. Such expressions are often mani- 
fest and direct. 

Tho open expression of affect appears to be a side effect, not neces- 
sarily unwanted, in most learning games. Neither the game rules or the 
suggested discussion or debriefing procedures afterwards are usually 
geared to deepen the exploration of feeling. Further expression and 
reflection could be done, although instructors ordinarily are not trained 
in such skills. One possible advantage of the simulation game is that the 
rules and player roles provide some safety of detachment for the player. 
A discussion concerning feelings "in the game" is less likely to arouse 
defenses than a discussion centering on "your feelings". 

Interaction Among Students 

Educational games are designed to maximize peer interaction as op- 
posed to student-teacher interaction. Almost all the games examined 
stimulate and reward frequent peer interaction. The effects of several 
hours of such intens5e communication between students in the classroom 
has been noted by a number of observers. One result is that the shy and 
diffident sometimes open up and become moderately talkative, and 
more active members of student groups. 

Another occasional result is that the classroom atmosphere appears to 
change. Students appear free to talk among themselves, to question the 
teacher, to take the initiative in bringing up points and expressing their 
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views. An effect more frequently observed is that students who have 
been turned off become turned on for a while. In the game the typical 
performance hierarchy of the A, the B, the C, and D student is dis- 
rupted. Frequently, boys who have been marked as underachievers or 
indifferent to school, come alive and play dominant classroom roles. 

Affective Cognitive Interaction 

Affective outcomes we have just discussed were achieved in a context 
primarily emphasizing problem solving, analysis and interpretation of 
information, deci::,ion making, the examination of the consequences of 
one's own actior and thc^e of others, the exploration of alternative 
possibilities, and pie-.iiction making. In learning games these affective 
outcomes are developed in interaction with cognitive outcomes. The 
learning games referred to were not -designed as a setting for an orgy of 
passion. It has been a continual surprise that so much affect has de- 
veloped in. an intended coguitive context. 

The technique of these educational games presents a unique oppor- 
tunity to integrate the cognitive, affective, and psychomotor aspects of 
learning. Eli Bower has pointed out that if one were to emphasize just 
the cognitive objectives in education, the result might be an ''intellectual 
giant with no emotions". On the other hand, if one were to emphasize 
the affective domain, the result might be an ''emotional explosion with 
no rationality. Educators are often prone to separate instructional 
objectives into neat categories (cf.. Bloom, 1956; Krathwohl, et al, 
1964), and often neglect to integrate what has been thought of as sep- 
arate. Further, the emphasis on passive reception through lectures, text- 
books, and the like, often leaves little room for the activities that inte- 
grate the various types of objectives in a v/ay that is meaningful to the 
student. Games and other simulations offer teachers an opportunity to 
deal with emotions in handling the problems that demand the applica- 
tion and integration of previously learned principles. 

Learning Game Variables that Facilitate Affective Outcomes 

Observation of a number of present educational games suggests that 
the following factors seem related to the production of affect. Games 
high in these factors appear to produce positive affect: 

1. The learners are active in self-directed behavior, making choices, 
carrying out decisions, etc. 

2. Feedback of consequences is frequent, visible, and often dramatic. 

3. Interaction among students is maximized, and interaction between 
student and teacher is reduced and changed in quality. 



^Personal communication 
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4. Both competitive and cooperative behaviors are heavily reinforced. 

5. Perceptual support, i.e., graphic art of resources, gains, losses, etc., 
is given. 

6. A tinge of uncertainty flavors the expected consequence of each 
move. 

7. The format emphasizes reward for accomplishment; punishment or 
aversive feedback is de-emphasized, 

8. The play and fantasy quality of the game enables the player to be 
immersed, yet feel comfortable. 

9. The concepts, symbols, and principles used by the player are large- 
ly selected and -transposed at his discretion and into his own style 
-they become part of hrs personal domrdn. 

The Reverse Side of the Coin: Negative Affeci 

Althougli the consensus of evidence poimts to those affective out-, 
comes previously described as typical of most student players— in most 
of the nationally disseminated games— a persistent minority report con- 
tinues: 

1. Not infrequently competition becomes intense— players manifest 
the. symptoms of extreme anxiety. 

2. Bitter hostility to opposing players and teams. 

3. If the game emphasizes winning even through destruction of others 
and covert cheating, players play the game to mn. They act like 
graduate students and university faculty.. 

4. Consistent losers dislike the game-sometimes— particularly if they 
have no hope of future wins, and perceive alternatives to the game 
as more rewarding. 

5. Students who need a high degree structure and order, find the 
typical learning game confusing and even oflensive. 

As any reader knows, there are educational innovations called 
^'books'' that are not worth reading. To identify an object as a *'book'' 
tells nothing of its effects upon readers. An "instructional game" may 
exhibit all the variance and more, including variance in the direction of 
stupidity, pallid obscurity, ennui, or gross sensationalism, observed by 
readers of ''books'*. However, the recent history of learning game design 
and development demonstrates that learning games can be designed to: 

1. Attenuate competition. 

2. Emphasize cooperation or integration of diversity as appropriate 
strategy. 

3. Provide handicaps, a hierarchy of leagues, or a different role~to 
eliminate the pliglit of the ''born loser". 

4. Present a variety of games dealing with the same content-S9me 
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structured, some unstructured; some highly cognitive, some pre- 
dominately expressive; others requiring a fusion of both. 
Every man to his own taste and a game for every man. 

Affective Outcomes of Media-Ascendent Simulations 

Let us now briefly examine what media-ascendent simulation has to 
offer for individuals interested in the affective domain. The discussion 
>/ill generally follow the same measures of affect discussed above. The 
reader should note the differences between interpersonal-ascendent simu- 
lation and media-ascendent simulation in terras of their potential for 
affective learning. 

Involvement 

Without question, individuals confronted with a media-ascendent 
simulations are shown to have an amazing capacity to *'throw themselves 
into the situations," Even though the simulation is clearly seen as not 
reality, still the learner behaves as though it were real life. (At least, that 
is what is hoped by the designer.) This phenomenon is remarkably il- 
lustrated in one partirular sequence shown on the popular television 
show "Candid Camera.'*^ 

This episode involved an individual delivering a key to a particular 
doctor*s office. The individual was requested by the nurse to sit in the 
waiting room and wait until the gentleman to whom the key belonged 
appeared. The television set in the waiting room was then turned on and 
the messenger observed what he thought was the middle of a "soap 
opera", which in fact was a staged plot involving the key which he was 
attempting to deliver. The doctor was irate because he had not been 
brought the key jn lime, and was complaining to another nurse about' 
the situation, Although the stimulus was presented by means of tele- 
vision, the messenger began interacting with the drama as though it were 
real. 

It has been observed repeatedly in classroom simulation training 
(Kersh, 1963; 1965; Tvvelker 1966) that some individuals become so 
involved in the simulation that they break down and weep, or become 
extremely frustrated, and even on occasion, simply refuse to respond. It 
has been noted by more than one observer of such situations that the 
classroom simulation training which includes discussions between the 
learner and an instructor, may involve more therapy than instruction. 

The authors have observed pilots in complex computer-controlled 
weapons simulators where involvement was so tense that the hidividuals 

9 Fail-Safe Exit for Non-Television Viewers 
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perspired freely. In these situations, 'it is clear that the stress is an 
important factor in creating tlie environment that produces this involve- 
ment.^^ In fact, the learners' perception of simulation as relevant and 
realistic or irrelevant and unrealistic./ It goes without saying tliat a char- 
acteristic of simulators such as fligjit trainers is the amount of stress 
that is placed, on the student /to perform, sometime.^ in difficult 
circumstances under limited period of time. In these cases, stress is 
probably most increased by le?irner overloading that is, by presenting 
the learner with too much information that demands him to make an 
excessive number of respon?^s or decisions in a given period of time. 
The rate at which a learner may receive information is dependent 
upon input difficulty, learner ability, and rate at which the input is 
presented. For example, in classroom simulation training, stress may be 
increased simply by increasing the number of cues to which a learner 
must respond. Wliether or not the instructor wishes to do this is depen- 
dent upon his objectives. If the instructor's objective is to exercise the 
student in making quick decisions under adverse conditions, such tech- 
niques of learner overloading to produce stress may be used. It should 
be noted, h wever, that research has not revealed the optimal level of 
information of overloading for various cognitive or affective outcomes. 
It might be that excessive student involvement may actually lead to a 
decrement in cognitive outcome. 

The authors do not want to leave the impression that all media- 
ascendent simulations produce such involvement as described above. 
Even creating the proper amount of stress does not guarantee satisfac- 
tory involvement. Smode (1963, p. 118) describes a situation where an 
aircraft simulator resembled quite closely the operational aircraft in 
function. However, students perceived it as being unrealistic; they 
claimed it was too unstable and hepci^ mc^? difficult to fly than the real 
aircraft. Tests showed this to be false, and pointed up the problem as 
one of motivation and involvement. Students did not give their un- 
divided attention to "flying'' the simulator as they would have in a real 
■ aircraft. A momentary lapse of attention caused the student to ''get 
behind" the craft and cause it to go into instability. Such lapses occured 
in the simulation experience because involvement was low. These lapses 
would not occur in the operational aircraft because involvement would 
be total (we hope). 

Incidently, involvement may not only affect students. In many cases, 
it affects the instructor even more. By this we mean that the instructor 
or the simulation designer in many cases becomes so involved in^^de- 

lOpail-Safe Exit. If a discussion of sii^ss seems stressful, re-enter in three para- 
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signing the simulation to be realistic 'chat he goes to extremes. By in- 
creasing the realism, many think that the simulation becomes more ef- 
fective. An extreme example of this type of designer involvement may 
be found in the University of Missouri's Nepali House, where Peace 
Corps volunteers have duplicated the ave^'age peasant abode even to the 
extent of "bringing in cow dung each week and replastering the floor 
with it", (cf., Loubert 1967). The relation between fidelity or realism of 
simulation and motivation will be discussed in greater detail below. 

Emotion 

Closely related to involvement as discussed above is the factor of the 
emotion. We are more concerned with those behaviors such as the ex- 
pression of joy, frustration, and unhappiness that may relate to or fol- 
low involvement. Cited above is the example of students in classroom 
simulation training who become involved to the point of frustration, and 
break down and cry. In fact, it is often noted in these cases that stu- 
dents experiencing this frustration will move right out of involvement 
with the simulated problem circumstance. Possibly it is too threatening 
to their pi^rceived self-concept. The removal of one's self from the simu- 
lated (and potentially threatening) situation has been aptly illustrated by 
Kersh (1962) in his early work in simulation. In the same simulation 
facility later used for classroom simulation, he attempted to determine if 
children would transfer learning from the natural setting to the simu- 
lated setting. That is, would a child react to a projected image of an- 
other person as he would in the real life situation? To test this, films 
were made of him asking a few questions and giving a few simple com- 
mands, such as "What is your name?" and "Write your name." Feed- 
back sequences contained the experimenter repeating the questions and 
comments more emphatically or praising the learner for his efforts. Fifth 
grade students were brought into the facility without revealing what was 
to be projected. When the films were shown, students were found to 
state their names, write their names, and do other things that were 
subsequently asked in the simulation films. It was found that the chil- 
dren's reactions to the films were almost identical with their behavior in 
real life. Kersh also found that if the sound level of the child's voice was 
low, and the feedback films asking for a louder answer were presented, 
the children' responded with increased sound levels. However, the in- 
teresting thing that was observed with one child, (and which halted 
further work with children) was that when the child was confronted 
with these filmed stimuli, he became so disturbed that he "withdrew" 
and assumed a fetal position in the corner of the laboratory. Kersh has 
reported to these authors that it took quite a long time to work with 
the child and bring him back into the real life situation. In fact, Kersh 
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was so impressed with the power of media-ascendent simulation in this 
situation that it eventually led to the development of the classroom 
simulation films for teacher education. 

The reader is probably well aware of the emotions elicited by motion 
pictures. Many can hardly resist crying, or minimally swallowing a tear 
or two when confronted with cruelty and Inhumane treatment given to 
the canine heroes of "Lassie Come Home" or "Dog of Flanders".^ ^ Few 
can resist laughing and in some cases even receiving a belly ache over 
some of the antics shown in comedy films. Is there any less chance that 
media-ascendent simulation can at least equal the intensity of these emo- 
tions, if not surpass them? 

Attitudes toward self, others and counUy. A good example of the use 
of media-ascendent simulation for changing attitudes toward self as well 
as other objects and people is in the area of cross-cultural (area) train- 
ing. Foster and O'Nan (1967) point out that an American's awareness 
and understanding of the foreign culture rv;th which he is working helps 
improve communication and his overall effectiveness. This is only part 
of the story, however, since the American should understand the values 
aid assumptions of his own culture since they inevitably influencp his 
thinking,' attitudes, perceptions, and behavior toward the other country. 
They suggest that insiglit to, and understanding of, the motives, values, 
thought patterns, and assumptions of self as an individual American are 
required. 

Once he 'knows hirhself,' he is in a better position to identify 
and understand important aspects of another culture and to 
increase his ability to modify his own approach. It is only when 
the American becomes aware of his behavior as a function of 
tlie values and assumptions which have become a part of him as 
a member of the American society^ that he is able to be some- 
what independent of the 'blinder' composed by cultural deter- 
minant and consequently more adaptable and effective in his 
behavior overseas. 

Often, the training approach in bringing about this behavior consists 
of the presentation of information about culture, that is, American cul- 
ture, history, and so forth. Often, it would seem that content is periph- 
eral to the goals of understanding one's self. Another approach assumes 
that more favorable attitudes and appreciation comes through increased 
knowledge, especially from a historical perspective. This approach seems 
limited in helping the American to be more effective in communicating 
and interacting with foreign nationals. A third approach discussed by 
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Foster and O'Nan involves the preparing of the trainee to be belter able 
to discuss the United States with foreign nationals and answer various 
questions about it. This approach emphasizes the importance of being 
well versed in world affairs and American policy. 

Since cultural characteristics are found to be deeply rooted as a 
determinant of behavior, simulation has been chosen as one of the most 
promising methods of this type of training which involves among other 
things the perception of, or empathy toward others. Stewart (1965; 
1966) and Daniclian (1967) report several simulation exercises utilizing 
the "Contrast American" approach that could be adapted for use with 
media. Presently, the simulation, which requires a behavioral event, as- 
sumes the form of role-playing scenes. One American advisor and liis 
counterpart meet in a cross-cultural encounter. The scenes are con- 
structed so that culturally derived behavior is evoked from the subject 
playing the role of advisor. It is conceivable that in time, the role of the 
countekpart could be filmed and a computer-controlled system be de- 
signed to train large numbers of personnel at one time, rather than the 
one-to-one approach now used. 

Another direction of innovation is the PACKAGE program approach 
developed by Grace and Hofland (J 967). PACKAGE involves the use of 
a variety of media to present information about an area or culture. 
Maps, picture cards, filmstrips, audio tape, video tape, and. motion pic- 
ture films are used. It should be noted that simulation is not a part of 
this approach, however, at least as defined by the authors above. How- 
ever, it would probably be easy to modify the system to capitalize on 
the strengths of simulation where appropriate. 

One other example of the use of media-ascendent simulation for 
developing attitudes towards others miglit be mentioned. An important 
aspect of the training of teachers and administrators in special education 
is the sensitization of these individuals to the problems of exceptional 
children. The authors suggest that media-ascendent simulation, as well as 
other role-playing techniques, be used to develop an awareness of the 
exceptional child's problems, handicaps, and everyday life patterns, 
whatever the case may be. Through such training the teacher could 
develop sensitivities to deal with the child. 

Attitudes Toward Instruction 

The review of the h'lorature shows that little has been done to mea- 
sure individual's attitudes toward instruction (the subject, school, learn- 
ing) in a systematic way. Anecdotal evidence suggests that simulation is 
regarded as beneficial (Kersh, 1965; Cruickshank and Broadbent, 1968). 

In some mea are, the effectiveness of the simulation to Jiange atti- 
tudes towards instruction is related to the feeling or the attitude of the 
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learner in the simulation experience, as compared with the feeling ex- 
perienced in real life. Smode et ah, (1963, p. 99) introduces the term, 
^'motivational similarity", to express this concern. It is pointed out that 
a primary factor in motivational similarity is the realism of the simula- 
tion. It is conceivable that a simulation might be designed that would 
produce optimal transfer except for the fact that its lack of realism 
causes the learner to disregard the instructional experience because of its 
obvious falsity. .If the student possesses attitudes that are negative 
toward instruction, then measures must be taken to assure proper con- 
ditions for instruction to be effective. 

One word of caution must be given when considering the physical 
similarity of a simulation, and this is relevant in designing a learning 
game as well as a complex simulator. The design of simulations is often 
times influenced by a desire to make them '*more appealing" and "in- 
teresting" to learners and this usually takes the form of increased real- 
ism of non-essential elements. If properly done, i* adds to the effective- 
ness of a simulation. It motivates the student, and he regards the ex- 
perience as meaningful and relevant. On the other hand, simulation 
designers often resort to "gimmicks" or what Lumsdaine refers to 
"fancying up" the device or technique which may cause distractions that 
may "interfere with the attention of the student to the essential task to 
be learned, and thus h^ve an adverse effect on learning rather than a 
beneficial one" (Lumsdaine, 1960, p. 283). 

Smode points out that motivational similarity is a function of the 
entire instructional program. The way in which tlie simulation experi- 
ence is scheduled, the way in which ih.Q experience is utilized, the qual- 
ity of the instructor, the "set" given to the students by the instructor, 
the "debriefing", and the development of the syllabus all effect motiva- 
tion. 

Parker and Downs (1961, p. 34) present other evidence that points to 
the importance of pre-simulation activities in the context of a flight 
simulator. They cite an unpublished study by Solarz et al. (1953) where 
one group of students were told how the differences in fidelity between 
the simulator and the operational aircraft made the trainer practically 
worthless. Another group of students were told that these differences 
existed but were of negligible importance in the value of the experience. 
Thus, the "set" given to the two groups of students differed, and in 
fact, an attitude scale showed that the groups' acceptance of the simu- 
lator was indeed quite different. In actual performance on the aircraft, 
however, the negative attitude group required more trials to criterion 
and hence more training time. While lack of simulator acceptance 
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lengthened training time, it has little effect on parallel transfer from the 
instructional situation to real life. 

Now it is difficult to speculate on the implications of the study to 
the conduct of simulations. Muckler (1959) points out that the pilots 
were highly motivated to perform at a very high level of competency 
and t' Is motivation may have overridden any decrements from the 
negative attitudes toward the simulator. It would be interesting to repeat 
the study with different classes of students-some of which were Iiighly 
motivated in the general sense to succeed, and some of which were 
potential dropouts. In this case, the factor of set may be shown to be 
quite important for transfer performance as well as instructional per- 
formance. In any event, the evidence presented by Solarz is but an 
indication of the importance of attending to pre- and post-simulation 
details. The authors suggest that a manual for a contextual response 
simulation should include the specification of these activities as precisely 
as those that are commonly thought of as the simulation experience 
itself. 

///. How Can Affective Outcomes be Produced? 

Adapting or Modifying an Existing Game 

The strategy here would be to find some educational game that tends 
to produce the desired affect. Identify the components responsible, em- 
phasize or add to those components, and perhaps minimize or remove 
other irrelevant or interfering components. To effectively modify exist- 
ing games and simulations in directions of increased outcomes probably 
requires some of the same knowledge of the, design and development of 
games as does building one from scratch. The following suggestions are 
given with that assumption. As a check list for increasing affect in an 
existing game, or adapting it to suit, we suggest the following: 

Components of a Simulation Game 
That Should be Scrutinized for Potential 
Affect-related Outcomes 

1. Goals: Are the stated goals or objectives primarily cognitive in 
nature? Can you adapt or supplement these goals so that feel- 
ings, attitudes, etc. weigli more? What about the implied goals 
of the exercise (''games develop confidence'' or "games change 
students' attitudes")-does the game design reflect ihese goals 
or are they merely glib generalizations? Do the game problems 
and goals tap enough motivation? 

/ Reality: Does the game include many -.'ements that are isomorphic 
to real-life processes, or few? Does it emphasize structures and 
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constraints that will elicit affect? Docs a lack of similarity 
between the simulation and real-life detract from desired affec- 
tive outcomes? How can factors be changed so that these out- 
comes can be achieved? 

3. Specificity: Does the game treat a process or structure in an ab- 

stract manner (with an hypothetical context) or in a wdy that 
is easily transferable to real-life contexts (e.g., a simulation of 
any firm is a simulation of a particular firm)? Does one or the 
other offer more in the way of desired affective outcomes? 

4. Duration: Is the simulation lengthy or brief? How long does it 

take learners to ''get into the simulation"? What allowances are 
made for possible dulling effects of a long simulation, especially 
one which is physically tiring or mentally fatiguing? How can 
short simulations be changed to generate affective outcomes 
quickly and dependably? 

5. Role-playing: Is role-playing fixed (limited behavior range and free- 

dom) or open (spontaneous behavior that is little structured or 
constrained)? What effect does the form and type of role- 
playing have on affect ("fixed" role-playing may be a powerful 
teaching tool per se but at the expense of affect). 

6. Resources allocated to players; Information, power, and material 

resources can facilitate or attenuate desired affective outcomes. 
Are these identified and their relationship to affect at least 
inferred? Does the original resource allocation include feelings, 
e.g., good-will, reduced anxiety, satisfactions, etc.? 

7. Alternative moves allowed and constraints: What alternatives are 

open to each player? What constraints are imposed? Do these 
change as the game progresses? Can these be modified to en- 
hance affect? among players: What sort of interaction is al- 
lowed? What are the predicted affective outcomes? Can the 
interactions be increased, channeled, or modified to increase 
affect? 

9. Feedback and rewards: Is the feedback and reward system in the 
game geared to affect? Are expressions of positive feelings rein- 
forced? Are agreed understandings of each other's position re- 
warded? Is the reward system primarily based on real-life pay- 
offs (e.g., improvement in making business decisions) or intra- 
game payoffs (e.g., improvement in status, prestige, or wealth 
within the game context not related to real life). 

10. Time schedule: Is there sufficient time allowed for the develop 
mcnt and expression of feelings? 



Many educational games give scant attention to such dimensions. They" 



Affect through Simulation 149 



rely primarily upon the scenario and the role interaction to provide 
affective propulsion. Most of these games can be substantially altered in 
the direction of increased affect as a result of such an analysis. 

In addition to the scrutinizing of game components discussed above, 
the gamesman may keep in mind a few principles that seem to hold in 
rnost situations where affective outcomes are desired: 

Maxims for the Novice Gamesman 

1. Provide for active and self-directed behavior by participants; 

2. Provide frequent, visible and dramatic feedback; 

3. Maintain maximal interaction among participants; 

4. Reinforce competition and cooperation; 

5. Present perceptual support of resources, transactions, etc. by 
means of graphic arts, photographs; 

6. Attach some uncertainty to each consequence; 

7. Emphasize reward, de-emphasize punishment; 

8. Reinforce the play and fantasy aspect of the game; 

9. Allow the player to transpose the conceptual content to fit his 
own repertoire; 

10. Pitfalls and potpourri from the memoirs of the wounded games- 
man: 

a. Be tuned in to thinking of simulations and learning games not. 
as an isolated game-playing session^ but rather as a system made 
up of: 

1. a briefing component 

2. the simulation or game component 

3. a debriefing or post-exercise evaluation 

4. a follow-up activities' component, all within the framework 
of an ongoing instructional unit 

b. There is more to instruction than simulation and gan.^^s. The 
authors have soberly tried to present these approaches objec- 
tively, but they realize that they, and possibly a reader, may be 
carried away with the strategy. Use simulation when it seems 
appropriate, and don't try to force-fit simulation, games, media, 
or love. 

c. Be sensitive to, but firm with those who hesitate or refuse to 
evaluate simulations. Simulations and games need to be care- 
fully evaluated as an innovation lest their demise be prcmatu;:e. 

Finally, it would be well to examine a set of suggestions for those 
areas in which media could profitably be introduced both in participant 
games and in machine-ascendant simulations: 
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Areas Open to the 
Employment of Media for 
Stimulation of Affect 

1. Sensitizing learners to the overall problem, or the model to be 
simulated; 

2. Orienting learners to their roles, particularly those emphasizing 
conditions that may cause affect; . 

3. Orienting learners to a model of affective behavior to be developed 
(a suggestion closely related to 2); 

4. Presenting critical incidents or problems which are loaded with 
affect; 

5. Presenting problem solving or coping strategies to critical incidents; 

6. Recording the participants' own affective responses during the 
simulation and allowing them to examine these and use them as a 
basis for further learning; 

7. Representing dramatically players of a) starting positions, b) 
moves, c) outcomes or various stages in a simulation game; 

8. Showing examples with degrees of inept affective interaction, 
which the players could remedy; 

9. Assisting a learner to disentangle the cognitive and affective 
threads in interpersonal communications; 

10. Monitoring or assessing learners' attitudes toward situations 
through simulation. Often, pictures can set the stage for respond- 
ing in an affective manner in a way that surpasses words alone. 
Simulation testing (sometimes referred to as situational response 
testing) elicits more true-to-life behavior than can less realistic 
forms of tests. 

Developing an Original Game 

This will require that either the technologist acquire skills as a de- 
signer or that he call in a specialist. Training in such skills is frequently 
given in workshops and institutes- A list of centers of gaming activity is 
presented in Appendix B. Many of these centers offer training, or in- 
formation on where training can be obtained- A brief account of the 
approach used at Teaching Research to develop simulations and games is 
given below.'^ We doubt if most instructional technologists could begin 
designing educational games from such reading, as only the higli points 
of simulation and game design are presented, devoid of specific de- 
tails-*^ '5 

^This at least is what our staff reports is the developmental procedure. No 
goodness-of-fit test has ever been applied to our report versus our actual develop- 
ment behavior. 

^The Teaching Research approach is discussed in detail by Crawfcid and 
Twelker (1969). 

^Fail-Safe Exit. Mental cravens may re-enter the last paragraph, of the chapter. 
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Figure 1 presents a summary of the sequential steps that may be used 
in the design and development of a simulation or gaming system. 

In designing an instructional simulation system, or any instructional 
system for that matter, it is useful to think of a gap-a difference 
between the learner 'where he is before instruction, and where he is after 
instruction. Before instruction, we assume that he lacks some knowl- 
edges or skills necessary to perform satisfactorily in an operational situa- 
tion. After instruction, we assume that he possesses tliese skills. Our 
problem is to specify the learning conditions necessary to bridge this gap 
between the learner's initial repertoire and final criterion repertoire. 

How best are these instructional conditions specified? Are there in- 
structional methods effective in all. kinds of learning activities? To be 
certain, there are some general rules-of-thumb that seem to hold in a 
variety of conditions, such as the provision for proper feedback, active 
participation, spaced practice, and so forth. Yet, it is clear that these 
guides do not lead us far enough down the road of instructional specifi- 
cation to be of much help at this stage in our technology. Too many 
decisions must be made in the course of specifying instructional condi- 
tions that cannot be answered by examining past research, theory or 
intuition. Decisions must be made in the best manner possible, and this 
requirement has in large part prompted the approach to be discussed in 
detail below. This approach may be summarized as: 

(1) Determining what shall be lauglit 

(2) Determining how it might best be tauglit 

(3) Validating the system 

System Analysis 

Step 1. Define instructional problems 

When the designer defines the instructional problem, he answers ques- 
tions such as: What i^re the essential characteristics of the problem? Is 
this information reliable and sufficient to act upon? What is the source of 
further" information? What are some ways I can use to solve the problem? 

Before one can improve instruction, he must step back and examine 
in broad terms what preceeded his decision to develop a new instruc- 
tional system, what procedures might be used, and what the conse- 
quences might be if his intentions were realized.' What condition has 
motivated his tampering with the status quo, and why does he believe 
that intervention can improve the conditions? 

Step 2. Describe the operational educational system 

Why analyze the operational system? Hamreus (1968) states that "We 
can no longer afford to engage in the process of modifying components 
of the educational system as if they were interchangeable; in changing 
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Figure 1. Steps in the Design of an Instructional Simulation System 
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any of the entities of the system wc cliange the system structure." What 
serves as suitable instructional experiences for a set of objectives taught 
in a given environment may not be effective for the same objectives 
taught in a different environment that has different constraints placed 
on it. For example, an excellent self-instructional system may not be at 
all appropriate for teaching two or more simultaneously. The constraints 
of the system in wliich the designer expects to operate must be de- 
scribed. 

One more point. What is thouglit to be a problem may not be the 
actual or total problem when the system is examined. Most likely, the 
analysis will uncover other conditions which must be related to the 
problem. 

In analyzing the operational system, the designer must define such 
factors as the .target group (the learners for whom the system is being 
designed), manpower capabilities-, support equipment, personnel schedul- 
ing, available curriculum materials, and description of course limits and 
developmental time. Also, the designer should examine such things as 
administrative limits, facilities, money available for developing the new 
system, educational orientation, and the environment of the learner in 
wliich instruction will occur. 

In summary, the designer should examine every element that will 
help him define the problem more clearly and to propose appropriate 
solutions. In many cases, the analysis of the system may require help 
from subject matter specialists and "natives" who have a thorough grasp 
of the educational system, its merits and deficiencies. 

Step i. Relate the operational system to the problem 

The inputs identified above must be related to each other and to the 
problems identified in Step 1. It makes little sense to think of an edu- 
cational problem in isolation to the context in which it is, found. The 
relating of the initially defined problem with the system may prompt a 
redefinition of tlie problem. In some cases the designer will face the 
chance of delimiting his interests and choosing certain aspects of the 
problems he has identified. This is based on the assumption that the 
more one knows about the system, the more clearly the problem will be 
perceived. 

System Design 

Step 4. Specify objectives in behavioral terms 

Stating objectives of learning in terms of what the learner should be 
able to do after instruction facilitates the development of criterion mea- 
sures as well as the specification of instructional experiences. An 
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adequately stated objective will lead directly to the specification of test 
item or items. But often times, the use to which objectives are put stops 
at the specification of test items. The statement of behavioral objectives 
is but the starting point in the design of instructional experiences. By a 
process sometimes referred to as hierarchical analysis^ enabling objectives 
which state the specific knowledge/skills that the leanaer must have in 
order to arrive at the terminal performance may be staled (cf., Twelker, 
1969). The prerequisite behaviors may then be analyzed in terms of the 
type of learning function represented. This in turn provides a basis for 
specifying specific experiences required to bring about the type of learn- 
ing identified. This analysis gives the designer an ample store of infor- 
mation to use when he determines the appropriateness of simulation and 
gaming as part of the instructional experiences. 

Step 5. Determine appropriateness of simulation or gaming 

Simulations and games are often more costly in both preparation and 
performance than more conventional forms of instruction. To justify 
this additional cost, simulation must offer marked advantages. We have 
listed below seven possibilities in which simulation may offer a useful 
and cost-justifying alternative: 

1. An emphasis upon emotional or attitudinal outcome. 

2. The combination of affective and cognitive behavior— planned inte- 
gration of feeling and thought can be affected by simulation over 
a range limited only by concerns of practicability. 

3. Motivation to initiate a sustained learner activity-a universal ob- 
servation of simulations is the high interest and involvement en- 
gendered, which alone may justify the development of simulation 
within an instructional program. 

4. Emphasis upon the learner interacting with a complex and reactive 
environment— so he can discover the effects of alternative deci- 
sions. 

5. Emphasis upon incorporation of the behavior within the personal 
domain of the learner— here the learner makes the concept, prin- 
ciple or value learned "part of himself." 

6. The application of behavior, particularly under a variety of con- 
texts-simulations and games may be designed so that additional 
variables can be carefully introduced into the exercise so that the 
learner can continue to function appropriately in a more and more 
complex environment. 

7. Emphasis upon a "perceptual frame'' to sensitize and direct the 
learner-putting the learner into a desired "set'' to shape the pat- 
tern of his selections of input and output. 
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To balance the foregoing somewhat ebullient points, let us briefly 
describe the debit side of the ledger. For which objectives is simulation 
of questionable use? The answer is straiglitforward: the acquisition of 
cognitive knowledge as measured by typical tests. Many of our cus- 
tomary instructional objectives relate to the acquisition of knowledge. 
Acquisition of verbal symbols so that the learner can recognize them, 
enumerate them, and regurgitate or recall them, all constitute a large 
share of present instructional intent. Generally, simulation offers a 
marked advantage here. On the other hand, no^.-simulation games are 
admirably suited for information acquisition and practice. Learning 
names, concepts, and principles so that they can be recalled verbally or 
recognized among alternatives is accomplished very nicely with non- 
simulation games. 

Exceptions to this generality should be noted and stem from the 
simulation indicants enumerated above. Conditions that indicate the 
fruitful use of simulation for acquisition of symbolic knowledge include: 

1. Learners are not interested. 

2. Learners are not adept at typical skills required for acquisition, 
such as reading (although some simulations require extensive study 
of role information, resources, etc.). 

3. Objectives place emphasis upon contextud exercise, uses and ap- 
plications of symbols. 

Othi3r considerations may mitigate against the choice of simulation. 
These include: 

1. Higli costs-both in terms of development and in terms of the time 
it takes to use. 

2. Problems of intrusion into current instruction-learning games 
often introduce considerable changes in noise level, physical move- 
ment, and teacher role and preparation that are objectionable or at 
least highly suspect to some instructors and administrators. 

3. Difficulty in evaluating learning outcomes-in part, because the 
marked advantages of simulation lie in those human processes dif- 
ficult to measure, demonstrable advantages (or loiises) may not be 
reportable. 

Step 6. Determine type of simulation or game required 

If a decision has been reached to consider the use of simulation or 
gaming, the next set of decisions relate to the kind, or the' attributes, of 
the simulation to be designed. The three major possibilities mentioned in 
our opening remarks are: 1) interpersonal-ascendant simulation, 2) media 
ascendant simulation, and 3) non-simulation games. Table 1 presents a 
summary of the advantages of each. 
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Step 7. Develop specifications for the instructional system 

The actual procedures are too lengthy to be detailed here. A number 
of sources are available for those interested in the details of designing 
simulations and games (cf., Crawford and Twjlker, 1969). 

In this step, the designer should rely on the most relevant principles 
of instruction, the best judgment he can bring to bear on the problem, 
and the tactics that are suggested by the analysis of the learning objec- 
tives mentioned in Step 4., as he builds the simulation or gamine 
system. It should be stressed that the design of a simulation game is still 
an art or craft, and many decisions that a designer has to make cannot 
be based on empirical evidence, much less a unified theory. 

System Validation 

Step 8. Generate criterion and evaluation insti'umeuts 

Two types of instruments are generated in this step. First, the de- 
signer should develop the measures for assessing whether or not the 
iitated outcome behaviors were acquired by the learner as a resul! of the 
instructional experience. At the same time, he may wish to also develop 
the measures for assessing enabling (prerequisite) behaviors necessary for 
adequate performance on the terminal objective. The second type of 
-instrument that should be developed are evaluative measures that assist 
the designer in making decisions on the subsequent revisions of the 
system. These instruments are designed specifically to shed light on 
weak points in the game, to elicit helpful information from the players, 
and in some cases, to assess learners attitudes toward crucial features of 
the garne. 

Step 9. Develop the simulation or game system prototype 

At this point, a good share of the work of design has been accom- 
plished, and the "fun" part of building the system begin'\ If the de- 
signer has "done his homework", development should proceed at a fast 
rate. The main task is that of translating instructional "blueprints" into 
prototype. The more complete and thought-out the "blueprints", the 
faster jnd easier the development. Althougli the blueprints should be 
adhered to as closely as possible, the designer should feel free to vary 
certain specifications ?r the production effort clearly calls for this. It 
should be recognized that the designer will have a ^-ertain number of 
production decisions to make that are- not '>pecified in his specifications 
from Step 8. Yet, these should represent relatively minor deorions. By 
the time the designer arrives at Step 8, he should have a very clear idea 
of the nature of the system and possible problem r^^- vvhere pro- 
duction techniques are certain. 
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Step 10. Tryout the system prototype 

An empirical tryout of the system is mandatory. The tryout is lim- 
ited in nature. If possible, small groups of learners, or even one learner 
at a time where appropriate, are taken through the systems by the 
desigtier(s). Close monitoring of the learners is undertaken. Analysis of 
the system includes empirical data on whether the desired outcomes, 
both terminal and enabling, were observed, but not limited to this. 
Learners may be requested to verbalize problems with the materials, and 
suggest alternate strategics. It should be noted that the limited tryout of 
a system such as a simulation game may "look"* quite different than a 
tryout of a media-ascendant simulation. A learning game that involves 
whole classes is quite difficult to monitor without constant "stopping 
down" of the game. The video-taping of such tryouts is an extremely 
effective way to capture activity for later analysis with a select group of 
learners sitting with the designers. Members of different teams could 
help identify where lags in timing occurred, vital relationships between 
players or teams did not properly develop, and so forth. 

It should be emphasized that the tryout is limited in scope-its ob- 
jective is to gain valuable information for Ihe revision of the system or 
system components. This is why enabling performance measures arc 
analyzed, as they help the designer detect weak points in the system 
that result in less-than-adequate terminal performance. In some cases it 
may be conducted successively. Sometimes, the simulation may be tried 
out on colleagues before using learners that represent the target group so 
that respons:>ible criterion may be obtained. In imy case, tryout leads to 
the next step, modification of the system. 

Step IL Modify the system prototype 

The three major decisions are made during this step: 

1. If the system seems appropriate for obtaining the stated objectives, 
how can it be improved? 

2. If the system does not seem to be appropriate for obtaining the 
stated objectives, how can it be changed? 

3. If the system does not seem appropriate for obtaining the stated 
objectives, sK./jkl it be discarded in favor of other types of sys- . 
tems? 

The designer must ascertain if the type of instructional experiences 
chosen is appropriate, and if so, what can be done to improve them. In 
some cases, the designer may even decide to discard simulation or 
gaming as an inappropriate technique, either due to cost, faulty design 
work in Steps 7 and 8, or other factors. Needless to say, the designer 
may recycle througli the steps of production, tryout, and modification 
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until he has achieved satisfactory results with the system, or has deter- 
mined its inappropriateness as discussed above. When the jjystem is de- 
veloped to a point that all components are in a form suitable for use by 
others independently, then the system is ready for a field-trial by se- 
lected target-instructors. 

Step 12. Conduct field trial 

" The field trial serves to aid the designer in determining if his newly 
developed system is capable of "standing by itself',, that is, being used 
in the field under operational conditions by members of tlie target 
population. Designers often neglect this crucial step, reasoning that 
"since I was successful in using the system, everyone else can use it 
now". Unfortunately, it is the rare system that is capable of beiaf^ used 
in such a manner. The safest thing a designer could do is to subject liis 
system to a trial under field conditions. When this is done, the designer 
may wish to collect data concerning: 

1 . Stated outcomes-effectiveness of the system in achieving the 
stated objectives; 

2. Unstated outcomes, such as, attitudes of learners and instructors 
toward the system; retention or transfer measures; other measures 
of motivation; and 

3. The manner in which the system was implemented-conditions, 
accunte descriptions of learners, setting, etc. 

In some cases, the designer might consider securing the services of a 
third-party evaluation team to conduct the field trial. The obvious ad- 
vantage is that the evaluators test the system and analyze the data in a 
totally unbiased manner. The simulation designer, by this point, has a 
large stake in the success of his system, and unintentionally may allow 
bias to cloud his conduct, analysis, and interpretation of field-lcial data. 
If such a procedure is followed, the designer should guard against ra- 
tionalizing or defending negative findings of the evaluation. Rather, he 
should modify the system to alleviate these negative points. 

Step 13. Make further modifications to th^ system 
deemed appropriate from field trial evidence 

When this point is reached, it is hoped that few "bugs" are found in 
the system as detected during the field trial. If the previous steps have 
been executed in an excellent manner, the field trial will indicate im- 
l^rovements, :iot major changes. In some instances, system components 
such as instructor's manuals and "pack jging'* may receive the majority 
of attention. At this time, the designer may also begin investigating ways 
to disseminate hi3 system. 
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A Final Word 

Sarane Boocock and E. 0. Schild state in their book on simulation 
games that: "Game design is not only not a science, it is hardly a craft, 
but rather an 'art' in the sense that we have no explicit rules to trans- 
mit." (Boocock and SchUd, 1968, p. 266) 

Others have made essentially the same statement of media-ascendant 
simulation. With this position, these writers do not argue. Further, the 
guidelines offered above certainly are not the final word. But, the use of 
systems approach to building simulation exercises is one step in the right 
direction. Meaningful research directions may be identified in the con- 
text of the development. 

At this point those readers may have attained those objectives orig- 
inally intended by the authors, i.e., he is able to: 

1. Identify the major categories and uses of simulation and gaming; 

2. Describe the affective outcomes often produced by simulations 
and games; 

3. List the major steps in either adaption or development of simu- 
lation and games. 

However, these are pallid cognitive objectives. A reader could attain 
these without experiencing any of the fire and involvement of simula- 
tions and games. To gain such experiences and to atta.''i the skills 
needed to implement an action, rather than verbally describe gam^cs and 
simulations, we. suggest that the reader play-as a participant-several 
current games and simulations.^^ 
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APPENDIX B 
List of Centers of Simulation Game Design 



Abt Associates, Inc. 

55 Wheeler Street 

Cambridge, Massaehusetts 02138 

Aeademie Games Associates 
430 East 33rd Street 
Baltimore, Maryland 21218 

Academic Games Project 

Center for Study of Social Organization 

of Schools 
3505 North Charles Street 
Baltimore, Maryland 21218 

Behavioral Sciences Laboratory 
College of Social and Behavioral 

Sciences 
The Ohio State University 
404-B West 17th Avenue 
Columbus, Ohio 43210 

Behavioral Simulation and Gaming 
Group 

Political Science Department 
Peoples Avenue Complex, Bldg. D 
Rensselaer Polyteclmic Institute 
Troy, New York 12181 
Attn: Marshall H. Whithed 

College of Education 
University of Oklahoma 
Norman. Oklahoma 73069 

Department of Sociology and 

Anthropology 
University of Southern California 
University Park 
Los Angeles, California 90007 

The Didactic Game Company 
Educational Services Division of R.B. • 

Enterpriser. Inc. 
Box 500 

Westbury, New York 11590 

Educational Simulation LaLoratory 
College of Education 
Ohio State University 
Columbus, Ohio 

Environmetrics, Inc. 
1100 17th Street, N.W. 
Washington, D.C. 20046 

Games Group, Mental Health Research 

Institute 
University of Michigan 
Ann Arbor, Michigan 48104 
Attn: Layman E. Allen 



Information Resources, Inc, 
96 Mount Auburn Street 
Cambridge, Mass. 02138 

Instructional Simulations, Inc. 
2147 University Avenue 
St. Paul, Minnesota 55J04 

Interact 

P. O. Box 262 

Lakeside, California 92040 

Kansas Educational Simulation Center 
Division of Social Sciences 
Kansas State Teachers College 
Emporia, Kansas 66801 

Learning Games Associates (WFF 'N 

PROOF) 
2253 Mcdford Road 
Ann Arbor, Michigan 48104 

Macalester College Simulation Center 
138 Cambridge Avenue 
St. Paul, Minnesota 55101 

National Academic Games Project 

Nova University 

S.W. College Avenue 

Fort Lauderdale, Florida 33314 

or 

24064 Avenida Crescenta V>enoia 
Valencia, California 91355 

Political Institutions Simulation 

(POLIS) Laboratory 
University of California 
Political Science Department 
Santa Barbara, California 93106 

Project Si mile -Western Behavioral 

Sciences Institute 
1150 Silverado 
La Jolla, California 92037 

Real World Learning, Inc. 
134 Sunnydale Avenue 
San Carlos, California 94070 

Simile II 

P. O. Box 1023 

1150 Silverado Road 

La .Tolla, California 92037 

Simulation Systems Program 

Teaching Research 

Oregon State System of Higlier 

Education 
Monmouth, Oregon 97361 
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Simulated International Processes 

Project of the International Relations 
Program 

1834 Siieridan Road 

Nortiiwestem University^ 

Evanston, lllinoi 60201 



Sociology Department 
University of Miciiigan 
Ann Arbor, Miciiigan 48 
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APPENDIX C 

Horn, Robert E. and Zuckerman, David W. (Eds.) Tlie Directory of Educational 
Games and Simulations. Cambri'Jge, Mass.: Information Resources, Inc.: (In 
press, targeted publication date. Spring, 1970) 

An extensively annotated listing of over 1000 simulations and games. 

Klietsch, Ronald, G., 'vViegman, Fred B., and Powell, Jim R.; Directory of Educa- 
tional Simulations Learning 'James and Didactic Units, Minneapolis: Instruc- 
tional Simulations, Inc., 1969. 

Over 100 listings of simulations, games and didactic units. 

Twelker, Paul, A Basic Reference Bookshelf on Simulation and Gaming. Stanford 
University, ERIC T Clearinghouse on Educational Media and Technology (in 
press). 

A basic resource for the novice gamesman. 

Twelker, Paul A., (Ed.) Instructional Simulation Systems, An Annotated Biblio- 
graphy, Corvallis: Continuing Education Publications, 1969. 

In addition to references on simulations, the V 'biiography contains over 
300 listings of games and simulations. 



